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ABSTRACT 

A study was -:onducted of four urban middle schools in 
Boston .serving 1,600 students, mostly from low-income minor it^» 
families, to assess urban public school effectiveness. School level 
practices were the primary focus of the study, but self -reports of 
classroom teaching behaviors were also studied in relation to student 
achievement through interviews with 20 to 30 teachers in each school. 
The study resulted in the creation and validation of indicators that 
schools can use to assess their climates, set policies for reform, 
and choose strategies based on research. More than 90% of the 
students placed a hig^ value on the importance of family and 
education, recognizing that they were in school to learn and get a 
good job in the future. Teachers in these schools were well educated 
and experienced, but their individual caring was not always mirrored 
on an institutional level. The most effective school combined 
emphasis on academic learning with an ethic of caring. Clarity of 
purpose and positive relationships cunong teachers were mirrored in 
higher levels of student achievement, higher rates of prosocial 
behaviors among students, and lower incidences of antisocial 
behaviors. Teachers who reported more frequent use of direct teaching 
and student-led small groups with teacher supervision had students 
with significantly higher levels of achievement in reading, 
mathematics, and problem solving* Teachers who reported more frequent 
use ox workbooJcs and other individual assignments had students with 
significantly lower levels of achievement. Indicators of input, 
processes, and products were developed and are summarized. An 
important contribution of the study was the development of a measure 
of higher order thinking and problem solving for students in grades 4 
through 8, the Test of Problem Solving (TOPS). In all, 56 tables and 
8 figures present the study data. A 208-item list of references is 
included. Four appendices contain instruments used, including the 
TOPS. (SLD) 
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Executive Summary 



The problems confronting urban public schools in the U'nited States have 
reached crisis proportions. Nowhere is the challenge greater than at the middle 
school level. Nationwide, the evidence confirms that students' academic skills plateau 
or decline, when they need to be developing higher level analytical and creative 
talents which are so important in this age of technology. More urgentiy, it is during 
early adolescence, the age of most middle school students, that our youtti become 
vulnerable to drug and alcohol abuse, teen pregnancy, suicide, and delinquency. 
Children raised in poverty, broken families, and disintegrated communities are 
especially at risk. More and more, schools are t)eing asked to meet the needs once 
provided by supportive families and caring community institutions. This is particularly 
so for schools in disadvantaged urban areas. 

In the face of tiiese overwhelming challenges, new findings from research offer 
some bases for optimism. This study of four urban middle schools serving 1,600 
studertts, mostiy from low-income, minority families, showed that more tiian 90% of tiie 
students placed very high value on the importance of family and education. They 
recognized that tiiey were in school to learn and to get a good job in tiie future. Being 
rich, having fun, and having a current job assumed much lesser importance. For ti^e 
vast majority, the American dream was still alive. Its not too late in middle grades, but 
schools, if not families and community agencies, must do more to shape positive 
expressions of these values. 

The teachers in these schools were well educated and very experienced. 
Ove.rwhelmingly, they were dedicated to serving their students not only in promoting 
their academic achievement but tiieir moral, social, and emotional development as 
well. Even ttie most disgruntled and disenchanted teachers cared deeply about their 
students. However, tills individual caring was evident at an institutional level only in 
certain schools. The most effective school combined an emphasis on academic 
learning witii an ethic of caring. The principal was key to promoting tiiis positive 



dimate. The most effective leader enabled teachers to work together as professionals 
and develop coliegial relationships. The darity of purpose and positive relationships 
among teachers were mirrored in higher levels of student achievement at ail three 
grade levels, higher rates of prosodal behaviors among students, and lower 
inddences of antlsodai behaviors. 

The wide-spread practice of assessing school effectiveness by determining how 
well their studentr do only on stsuxjardizsd tests of tsasic skills, often a single reading 
subtest, was a dissen/ice to teachers and to students. In the four sample schods, 
reading test scores had very low correlations with students' final grades in reading, 
yet the test scores were used sometimes exdusively as the basis for student 
assignment to programs. Teacher judgements carried little weight; only test scores 
counted. For some teachers, the irrplication was dear: Don't exercise professional 
judgements based on years of experience and advanced degrees in subject matter 
and pedagogy, just teach to the test. For more dedicated teachers, the practice w^s 
demoralizing: for students, tiie results were rigid tracking and oeif fulfilling prophedes. 

School level practices were ttie primary focus of ttie stucly. but self reports of 
classroom teaching behaviors were also studied in relation to student achievement. 
Teachers who reported more frequeni use of direct teaching and student-led small 
groups witti teacher supervision had students with significantly higher levels of 
achievement in reading, mathematics, and problem solving. Teachers who reported 
more frequent use of workbooks and other individual assignments had stijdents with 
significantiy lower levels of achievement on most measures at most grade levels. 

Since the use of time is a critical factor, not only in student learning but in the 
restiucturing of schools, the study inquired how students spend tiieir time outside of 
school-after school, on weekends, and during the surrmer. The students spend only 
six hours a d&y in school. They are dismissed in tiie early afternoon. Most have little 
else to do but watch television or hang out. Many go home to empty houses whe''e 
tiiey take care of younger sidings. The picture v\^ich emerges fi-om the data overall is 
tiiat 5tuderTts have few chdces and littie staijcture to guide productive use of tiieir time. 

The major conti-ibuUon of tiiis research has been tiie creation and validation of 
indicators which schools can use for themselves to assess their own dimate, set 
priorities for reforms, and dioose strategies ttiat are based on research. 

vi 
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CHAPTER 1 
IMPETUS FOR THE STUDY 



Overview 

Some things never diange, or so it seems. One of the most influential books ever 
written about schools, the 'Coleman Report' was published nearly a quarter of a 
century ago. Officially titled Equality of Educational Opportunity (Coleman, J.S., 
Campbell, E.Q., Hobson, C.J., McPartland, J., Mood, A.M., Weinfeld, F.D. & York, R.L.. 
1966), the report was yndely interpreted to mean that schools don't make a difference, 
that educational attainment is largely independent of the schooling a child received. 
While no one has disputed the importance of home background to school 
achievement, the claim that schools don't make a difference has been largely refuted. 
The report has been cited in literally thousands of studies of the effects of teaching 
and schooling which have been written since then (Walberg, 1990), most of them 
criticizing what have become well known conceptual and methodological flaws in the 
Coleman study. One flaw which was particularly striking in retrospect was the use of a 
single measure of student verbal ability which was not dosely geared to what schools 
sought to teach. Yet that practice has continued to this day, by school systems which 
gauge their progress on the basis of scores from a single test. 

One such system is the Boston Public School System, the site of the present 
study, where the Metropolitan Achievement Test in Reading (Prescott, G.A., Balow, 
I.H.. Hogan, T.P, and Farr, R.C., 1988) has assumed a life of its own as the gatekeeper 
for student placement and promotion. These reading scores are used sometimes 
exclusively as the basis for student assignment to programs; and scores below an 
eighth grade level disqualify students for graduation. New scores are heralded each 
June in local newspapers, and the success or failure of the system is seen to coincide 
with rising or falling MAT reading scores. Yet it has been detemnined for the four 
middle schools which constitute the sample for the present study, that reading scores 
and teachers' judgements of how well tiieir students are doing in reading have a very 
low correlation; they have almost no overlap. 
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The implication is dear. Teacher judgoments don't count, only test scores. These 
high stakes testing practices fuel mearurement driven instruction. Teachers know that 
they and their schools will b9 held put)iicly accountat)le for their children's test scores. 
And so the solution for many teachers is just as clear. Don't exercise professional 
judgements based on years of experience and advanced degrees in subject matter 
and pedagogy, just teach to the test. 

The most widely used metric for assessing school effectiveness, not just locally, 
but na\.onally, has been student scores on standardized tests of basic skills. Yet this 
practice fails to credit schools for the moral and social education of youth, for the 
qualify day-to-day experiences students have in school, and for providing health 
and social services meeting basic human needs for a number of students. In addition, 
it provides little incentive for schools to go beyond basics. This project defined more 
broadly the desired outcomes of effective schooling and examined Vie practices and 
conditions ;p ihe school environment which appear to promote positive behaviors. 

Rejearchers, governmental officials, policy makers, and educators have beer, 
clamoring for better indk^tors to gauge the health of our nation's schools. One of the 
startling findings whteh emerged from 'A Nation at Risk' (National Commission on 
Excellence in Education. 1983) was the dismal condition of statistical information 
about education in this country; if the schools were suffering from a 'rising tide of 
mediocrity.' school performance 'coked robust compared to the condition of the 
statistrcal data base. Since then the need for educational indicators has captured the 
attention of virtually every group or agency involved in the business of education from 
the local to the international level (Smith. 1988). 

A well developed system of valid indicators in place over a period of time wou.d 
be tremendously valuable, not only for describing outcomes but for anticipating 
problems and planning solutions. At the heart of this goal is the question of what 
indicators woukj be most valid and most useful. A debate continues about whether to 
include measures of the schooling process. Some researchers and policy makers 
have argued that outcome indicators will contribute most to our understanding of the 
performance of ♦he educational system (Mumame, 1987; MacRae & Lanier, 1988). 
Others insist that indicators . "^e schooitng context are as necessary as outcome 
indtoators (Smith. 1988; Oakes, i989). This project was most persuaded by the latter 
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position, and set out to generate and validate indicators of educational inputs and 
processes, as well as products. 

Indicators of Inputs 

The same limited measures which have k>een used for the past 25 years to 
assess the results of schooling-most notably, standardized, multiple-choice tests of 
low level knowledge and skills, as well as drop-out, retention, and graduation rates- 
are still being used today. They were woefully insufficient then; they are even more 
inadequate now. What's more, educational inputs have changed, and the demands 
placed on educational institutions have increac:ed dramatically on every front, but 
particularly in urban areas. 

Albert Shanker likens the efforts to shape up educational systems through a 
regimen of tough, businesslike regulation of standards to stepping up an old assembly 
line which is hopelessly inadequate. Questioning reforms which demonstrate an ill 
founded faith in the traditional model of education that seems almost religious, he 
offers a short course in recent history of education. Fifty years ago, times were simpler. 
Broken families were unusual; parents pushed their children to excel; mothers stayed 
at home; commercial television didn't exist; drugs were practically unknown. But even 
under these conditions, only 20% students graduated from riigh school. Not until 
1953 did a majority graduate (Shanker, 1990, p. ?A7). Not only are circumstances 
differi^nt today, times have changed in other ways. What used to be considered 
education for the elite, must be available to the masses. Basic skills are not sufficient 
for most work in the 21st century. We need a labor force and a citizenry able to tiiink 
for a living. 

Who are the students attending our nation's schools today, particularly our urban 
public schools? Who are they, not just in terms of general demographic 
characteristics, but what do they value, and what are ttieir hopes for tiie futrre? Who 
are ti.j important adults in their lives, and what importance do tiieir families place on 
education? How do these students spend tiieir time outside of school, after school, on 
weekends, and during the surrvner? 

The changing complexions of the student body are obvious, and so are tiie kinds 
and number of languages spoken. Stereotypes abound as to what these children are 
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able to do and what their families want; only some of these stereotypes are accurate; 
happily most are not. Indicators which report on these issues can help to dispel 
stereotypes and encourage more appropriate high expectations for all students. Many 
responsit>le educators are won-ied about the emergence of a permanent underclass. 
These are young people wtx) have lost the dream, who no longer have hopes for a 
better future forged through family ties, education and hard work. The same indicators 
of values would aid early identification of the.«fi individuals so desperately in need of 
assistarx;e. 

What inputs are there from the teachers' poln* of view? What do they care abouf? 
What is important to them professionally and v>/hy did they choose teaching? Why do 
they remain in teaching? What opportunities are available to them to grow and 
develop as professionals? What priorities do they think their schools should set for 
meeting students' needs? How do principals and their administrative teams feel about 
the same issues? 



Indicators of Processes 

Two decade ago, research evidence was seen to indicate that whatever we try to 
do to improve schools, it won't make a difference in the disparity between the 
academic perfonnance of children of the poor versus the well-to-do, of blacks and 
minorities versus whites. Family background factors, not school factors, con-elate most 
highly student achievement (Coleman, etal., 1966; Jencks, etal., 1972; Smith. 
1972). But this old generation of research examined school inputs in relation to 
school outputs, without regard to what took place inside schools. The new generation 
of research on school effectiveness does not dispute the critical importance of home 
background on student achievement: rather, the newer studies address factors which 
can influence student learning at the school and classroom level. Thus, in a major 
paradigmatic shift, the black box model of research on schools was replaced by more 
Illuminating process-product studies which could look inside schools to examine what 
could done to promote student learning. 

Results of the new generation of studies have been much more encouraging. 
Excellent summaries have been offered by Blum and his colleagues at Far West 
Laboratory (1986), Cohen (1983), Good and Brophy (1985), Puri<ey and Smith 



(1983), and Walberg (1990). among others. Effective schools start with effective 
teachers-those who have a high sense of efTicacy and responsibility for their teaching 
(Berman et al.. 1977; Aston, Webb & Dodo. 1982). They set high expectations for their 
students and hold students accountable for learning (Brookover at a/.. 1979; Good, 
1982; Rosenshine 1979; Stallings & Kaskowitz. 1974). The evidence for the 
effectiveness of these dassroom level behaviors is even more striking for traditionally 
low achieving students. Within such businesslike, task-oriented environments where 
rules of conduct and academic procedure are clearly explained, effective teachers use 
well organized, well prepared lessons which engage students ir more time on task, 
especially in greater amounts of academic learning time, than those teachers who are 
less effective in improving student learning. 

Building level practices beyond the control of the individual teacher also 
contribute to effective schools. While much more is known about effective teaching 
practices from studies of the classroom unit, research is mounting on dynamics in tiie 
more complex organizational structure of the school in relation to student leaning. 
Factors which emerge in the research witii some consistency include both the 
academic and the social culture of the school. First, effective schools, especially tiiose 
at the elementary level, appear to have tight coupling between the stated curiculum 
and instructional practices-schoolwide. Clear goals are publicly stated. The 
differences between classes is not great; the individual teacher's right to autonomy is 
superseded by the teachers' collective responsibility for coordinating curriculum 
across classes and grade levels. *Vhat's more, the tests used to evaluate teacher 
effectiveness and student performance closely match the stated objectives. 

By the time tine present study was conceived and designed, the second wave of 
school reform was about to begin. The first wave, propelled by news of the 'rising 
tide of mediocrity, '^as characterized by tougher standards and more control: 
increasing graduate requirements; imposing grade retention and other sanctions for 
poor performance; more standardized testing; more prescriptive certification 
processes, and more formal teacher evaluation. The second wave has a more 
exciting agenda, including participatory school based management; cooperative, 
collegial school environments for both students and staff; flexible use of time; and 
emphasis on higher order skills for all studints. 



What happened in beNveen was growing awareness that we may be on tiie wrong 
track. The central theme of the first wave of refomn was competitiveness, evidenced in 
calls for setting standards by tests, whose own psychometric qualities were suspect. 
The limits of testing were ignored as more and more testing was prescribed. The 
evidence began to mount that these kinds of refomris vi/ould fall far short of their goals, 
and even counterproductive. In a major study of 1,000 public and private high 
schools, Chubb & Moe (1988) compiled profiles of high and low perfomnance schools- 
•those in the top and bottom quartile of composite academic achievement measures. 
The profiles addressed four characteristics: formal structure; infomial organization; 
classroom practice; and student bodies. Their analysis turned up small differences in 
formal structures and classroom practices, and, not surprisingly, dramatic differences 
in their student bodies, the more advantaged students attending the high performance 
schools. 

What was much less predictable was that the s^ hools at the top had strikingly 
superior informal organizations. The top schools had a mission focusing usually on 
goals such as mastery of learning, the development of student self-esteem and 
efficacy. Principals were more successful in gaining their teachers* confidence and in 
communicating and pursuing a vision of what the school should accomplish and how 
teachers can contribute through instavdion. Decision making was more democratic 
and relationships more cooperative. Teachers in high achieving schools were more 
knowledgeable about each other's wo^k, each other's students, and each other's 
course materials. They were more helpful to one anotiier; in short, they were better 
colleagues (Chubb & Moe, 1988). 

The importance of school climate for school effectiveness cannot be 
underestimated, according to the findings of other major studies as well (Brookover. et 
al., 1979; Epstein & McPartland, 1976; Rutter, et al., 1979; Ellet & Walberg. 1979; 
Powell, Fencer, & Cohen. ^985; Goodlad, 1984). The school dimate communicates 
important messages for peer group nomis, student interaction, and student -teacher 
interaction. There is also important research on how work norms among the faculty 
appear to be especially important detemiinants of schod effectiveness (Little, 1983). 
When teachers have a shared sense of collegiality and colledively embrace the need 
for continuing improvement, they create more constructive and productive 
environments for teaching and learning . 

6 
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While the findings from research on what effective schools are like are becoming 
Increasingly dear, how to transform an ineffective school into an effective one remains 
a major hurdle. This project set out to help schools begin that process for themselves, 
by collaborating with schools in the development of indicators, grounded in research, 
which they could use to establish baseline data on their own school climate. W(> 
benefitted from Anderson's (1982) excellent critique and synthesis of school climate 
indicators which concluded that most existing measures of school climate focused on 
only a few dimensions of school climate; they were seldom combined to capture the 
essence of climate. 

We subscribed to Anderson's (i982) conceptualization of climate, adopted from 
Tanguir (1968), for identifying the factors which are perceived as shaping a school's 
climate. Climate is a summary concept which includes the ecology (physical and 
material aspects), milieu (presence of persons and groups), social system (patterned 
relationships among persons and groups), and culture (belief systems, values, norms, 
and meaning reflected in behavior). We tried to develop comprehensive measures 
which would examine several of these important components in relation to 
achievement, from several perspectives-the students', teachers', and administrators'- 
using multiple methods-observaticrt, interview, questionnaire, and the schools' 
ongoing record system. 



Indicators of Products 

'Conclusions about the direct instructional effects of schools should not have to 
rely on evidence relating to skills taught incidentally' (Madaus, Kellaghan, Rakow, & 
King). We would not repeat this mistake made by the Coleman study (Coleman et al., 
1966). Instead, we sought measures of specific achievement which were closely 
aligned with what the schools attempted to teach. While teaching to the test was 
prevalent in the schools which would constitute our sample, we sought not to use 
standardized tests of basic skills as the principal criterion measures of academic 
achievement. Instead we hoped to use criterion referenced tests developed by teams 
of teachers to assess perfomnance on local objectives which would be used system 
wide. In either case, it wouki be important in a system whose teachers and students 
felt 'tested to death' not to request additional testing time which would duplicate what 
the system already imposed on itself. 



A major contribution to the need for indicators which has been attempted by this 
project is the refinement and validation of an efficient measure of higher order thinking 
and problem solving which might be used for students in grades four through eight. 
Set in the context of real life problems thought to be of interest to the target age group, 
the items on the new test were developed to measure scientific reasoning, including 
the student's ability to identify and define problems; decide what information and 
investigations would be needed in order to find some solution to the problem; judge 
the adequacy of hypotheses; detect flaws in data gathering procedures or en-ors in the 
data themselves; organize, analyze, and interpret the data; 'iuggest some solution to 
the prot)lem based on the data; and suggest ways to implement the solution (Shann, 
1976. p. 65). 

Not only did we set out to go 'beyond basics' in the development of a new 
cognitive measure, we wanted to generate indicators of the quality of life in schools, 
the sense of caring and belonging felt by the students and reflected by the teachers. In 
addition, we wanted indicators of prosocial behaviors in schools as worthy outcomes 
in their own right, not only as enablers of higher academic achievement. The kinds 
and frequency of volunteer sen/ice which students offer to their communities were also 
of interest. 

Increasingly, schools are being targeted as the center for the dissemination of a 
broad range of health and social services. This is particularly so for schools in 
disadvantaged urban areas. Here many students go to school to find an environment 
which is safer, warmer, or more secure than home, where they can get a nutritious 
breakfast and lunch they would not otherwise have, and where they can interact with 
caring adults. Hospitals, courts, and other social agencies have targeted urban 
schools as the points to access children and youth in need of prevention and 
intervention programs, before it's too late. Schools are being charged with meeting 
basic human needs formeriy served by the family, the church, and other institutions in 
society. Without these sen/ices. we may well have a society in chaos. Our instruments 
were designed to document from the teachers and the students points of view whether 
these sen/ices were being provided and how important they were to the recipients. 
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Signifrance 



Of special significance is that the research has been conducted in middle schools 
which until recently have been largely ignored in the school effectiveness literature. 
On several counts, it can be said that here is the level of greatest need for inquiry on 
effective school practices. The cuniculum at this level nationally has been termed a 
'wasteland* by responsible educators. Moreover, it can be argued, here is where the 
trouble begins. Academically, basic skills plateau or decline, as attested by recent 
reports of test scores released for the Boston Public Schools. Nationally, data from 
the National Assessment of Educational Progress mirror the same pattern, with 
declines in criterion - referenced performance measures t)eginning at the fourth- 
grade level. But the risks are pervasive; early adolescence, the age of most middle 
schoolers, is an age of particular vulnerability-for drop out, pregnancy, drug and 
alcohol abuse, suicide, and delinquency. 

Schools can and do make a difference. Students at greatest risk for failure in life 
are those who drop out of school, who do not achieve basic functional literacy skills. 
Using appropriately designed studies and sensitive indicators of what schools actually 
try to do, evidence can be obtained to document the successes achieved in effective 
schools. The research can also be used to establish the linkages between effective 
practices and the desired outcomes, and to guide efforts to make other schools more 
effective. It is this kind of evidence which can be most persuasive in seeking greater 
public and corporate support for school improvement. 
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CHAPTER 2 



STRATEGIES FOR COLLABORATIVE RESEARCH AND 
THE REALITIES OF URBAN MIDDLE SCHOOLS 



Preliminary Efforts at the University 

In March, 1987 the principal investigator convened a group of senior faculty and 
doctoral students to consider university-school collaboration in research on school 
effectiveness. Each of the doctoral student participants had taken a research course 
with Professor Shann in the previous four semesters, a course which featured topical 
seminars in teacher and school effectiveness and which required students to produce 
research plans extending the state of knowledge and informed practice in these areas. 
Outstanding students were invited. 

The group added new members and continued meeting into the summer. By Fall. 
1987, we had established a clear consensus: that research on school effectiveness 
was inherently limited in its over-reliance on measures of basic skills as tiie measure 
of effectiveness, and that middle schools were largely ignored. (Most of the U.S. work 
focused on elementary schools and to a lesser extent secondary schools, although the 
reverse was true for British studies.) Yet, middle schools are probably the last chance 
to inten/ene effectively into the cyde of ignorance, poverty, and failure which afflicts the 
urban poor and underclass. 

We endorsed the model of school effectiveness proposed by Fred M. Newmann 
and his colleagues (1987) to guide their research at the National Center on Effective 
Secondary Schools. Their focus on student engagement as the most direct influence 
on student achievement can be generalized to other outcome measures t>eyond basic 
skills. We wanted to examine practices which might heighten students* engagement of 
academic, social, and moral issues-through teacher-student interaction, cumcular 
structures, and the culture of the school. 

We also benefited from continuing communication with Joyce Epstein and 
consideration of the research program for effective middle schools at the National 
Center for Research on Elementary and Middle Schools. Their coiTiments on group 
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diversity and individual variability, the development of self reliance balanced by 
continuing adult supervision, and other dilemmas posed by conflicting needs in the 
developmental stage of early adolescence guided our observations and interviews 
which we used to document instructional as well as noninstructional influences on 
adolescent engagement and achievement (Epstein, Btal., 1985). 

Collaborative Planning with Colleagues in the Schools 

A cornerstone in the planning for this research was that it must be collaborative, 
i.e., university-based researchers, both faculty members arxj doctoral students, must 
work collatx>ratively with teachers, principals, and other practitioners in the field to 
shape the research questions, implement the design, analyze the findings, and 
translate tiie results into practice. 

Boston University has had a long history of collaboration with tiie Boston Public 
Schools. While tiie University has developed many linkages, dtywide. it has worked 
most dosely with one distiict in tine system. Ushered in as part of \ne court ordered 
desegregation plan instituted in 1975. tine paring linked Boston University schools 
in that disbict. tiien. as now. ser.^ng poor minority neighborhoods, with increasingly 
diverse ethnic minorities and different languages represented. 

Starting with tiie Centi^ai Office in September, 1987. we pursued our request with 
the district superintendent. Botii the central office representative and the district 
superintendent stated support for tiie project. Botti understood tiie research need for 
variance in the schools' achievement levels, and both were sensitive to the p.obable 
reaction of schools publicly labeled 'low achieving' toward participation in still another 
threatening study. The district superintendent recomr.iended that we take all four 
middle schools in her distiict. in order to prevent the inevitable response. 'Why us?' 
The four schools were variable in their rates of student achievement-whether their 
perfomiance was measured by test scores, or whether the assessment was the 
estimate of knowledgeable observers-*but all four schools served stijdents from 
economically disadvantaged urban families. We were well advised to seek 
collaboration in the research in tho district we had worked with most dosely in the 
past 
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Students in these four schools can be described as low income, inner dty youth, 
with a concentration of Blacks and Hispanics and a growing number of diverse ethnic 
and racial minorities. These schools have, on average, fewer than 10% whites. 
School 1 enrolled approximately 700 students in 1989; Schools 2 and 4 enrolled 
approximately 400 to 500 students, and School 3 had almost 300 students, including 
a substantial number of special needs students-approximately 100~who attend a 
school within a school. 

We were able to meet with the prindpals of the four middle schools chosen for the 
.sample in Spring, 1988 to discuss the research and inquire about their willingness to 
begin a long term (three- to five-year) collaborative effort. Initial skepticism, even 
cynicism, gave way to more positive discussions of F>ossibilitles for building the 
schools' capabilities and providing incentives for teachers who had seen many a 
researcher come and go without ever hearing the results. (Doctoral students galore 
from several area universities had invaded their midst; faculty members reportedly 
were no more thoughtful of their hosts; some even 'went public' with still another 
negative report to the local press.) The prindpals were listening, but their teachers 
had to be persuaded as well. 

By June, 1988, the research team had met with some 20 to 30 teachers at each of 
the four middle schools to explain the project, and to request initial partidpation in the 
form of answering a draft of the school climate questionnaire for teachers, 
commenting on the instrument, and advising what additional issues should be 
addressed. Four doctoral student parb'dpants were supported to assist with this 
instrument development and data collection by stipends awarded from the Alumni 
Fund of the Boston University School of Edjcation. No support for release time or 
ether expenses was available to the project at that point. Even so, the principals and 
the teachers wanted to know: 'What's in it for us?' 

Our initial meetings with the four schools to pursue this research suggested ttiat 
frequent and sustained contact with the teachers and administa'ators would be needed. 
While they were weary and skeptical, even the most cynical seemed eager for 
opportunities for true collaboration. Adding to their list of 'what's in it for us,' they 
identified a long list of 'perils' and incentives for teachers, and items for the school. 
Some requests had no relationship to the proposed collaboration. Advised that any 
potential sponsor for the research would want to see a rationale for the item which was 
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project related, the list became more focused, including but not limited to: credentials 
as Boston University 'Research Associates' for those who take primary responsibility 
for effecting the collaboration; dynamic and knowledgeatde speakers to liven their 
professional days; expert consulting on translating research into practice, particularly 
in the areas of moral education arxi mastery learning; arxi information on the latest 
educational research. Most of these requests were incorporated into the research 
plan. A line item in the budget was designated to purchase journal subscriptions 
and recommended research references to start professional libraries in each of the 
schools for tea-^iiers. Reprints and photocopies of selected articles were exchanged 
on a regular bas\s. 



Research Advisory Council 

As the collaborative planning took hold, we needed to identify a smaller number 
of participants from the schools who would share responsibiCty for data collection and 
work with the university-based researchers in all aspects of the implementation and 
reporting of the research. An advisory corrtmittee was formed. Numbering 35 
representatives in all. its university based participants included: the project director 
and five additional senior faculty members of the BU School of Education, the project 
coordinator and two other advanced doctoral students. The school based 
representatives included the district superintendent and a team of six people from 
each of the four schools-two administrators and four teachers. We asked that three of 
the teachers from each school be chosen to represent each of the middle grades and 
one to represent non-graded support services or special programs. We also asked 
each school to invite a parent to join its team, however, only one school was able to 
involve a parer t in any substantial way. 

Two general meetings of the advisory council were cot .ducted as late afternoon 
workshops and dinner meetings at an attractive ccnference facility located on the 
canipus of Boston University. The first workshop was used to review a final draft of tiie 
student questionnaire, scheduled for administi-ation the following montii. Were we 
asking Vhe right questions? What difficulties did the teachers envision in \Sne 
administration, and what could we do to facilitate the process? The second 
conference wori^shop five months later was used to review the results of descriptive 
statistical analyses from this questionnaire and to seek advice from the field based 
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representatives on how to translate our research findings into meaningful guidelines 
for practice for their teachers. A sodal hour ffxm 5:30 to 6:30 was used for informal 
discussion; then a dinner was served. This format was selected after discussing with 
principals and teachers 'what's in it for them.' They wanted to be treated like 
professionals, given a voice in shaping the agenda, and recognized for their insights 
and experience. 'A nice dinner meeting in a pleasant surrounding would insure good 
attendance.' Again, we had been well advised. 

In addition to the conference meetings, the research team members met 
regulariy as the need arose with advisory council representatives as well as other 
professional staff at each of the four schools. Periods of data collection with the 
students and teachers required several trips by the project team members to each 
school. Teacher interviews were scheduled at the convenience of each teacher, 
requiring many more visits. 

After the data were processed and analyzed, and results were available 
infomnally, we invited the principals or the directors of instruction individually to join the 
principal investigator and project coordinator for meetings over lunch at the 
University's Faculty Dining Room. The review and discussion of the results often 
continued into the afternoon, as we collaborated in interpreting the results and sought 
advice on how to communicate the findings to their teachers. These efforts to date and 
the requirements for collaborative research have been recounted in some detail to 
underscore the demands which truly collaborative research entails. There are no 
shortcuts. 



The Focus on Indicators 

Tremendous strides have been made in knowledge about school effects and 
about characteristics of effective schools since the 'gloom and doom days" of the late 
I960's and most of the 1970's, which were triggered by the Coleman Report (Coleman 
et al., 1966) and fueled by several critical studies which followed (Plowden Report. 
1967; Jensen, 1969; Jencks, 1972; Averch etaL, 1972). Since then we have leamed 
a great deal about effective teaching practices, effective leadership practices, positive 
school climates, staff development, the importance of coMegiality. teacher 
empowerment, and more. What we don't know as much about is how to translate 
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these research findings into practice-how to maintain such a fragile entity as an 
effective school, and how to turn ineffective cr less effective schools into more effective 
ones. 

A step toward the solution of the newer puzzle is acquiring the ability to gauge 
and monitor the health and efficiency of an educational institution in order to point the 
way toward its improvement. In order to do this, we need indicators. Selden (1988) 
noted that pertiaps the most alarming outcome of the spate of reports on the health of 
American public schooling which began with A Nation at Risk is how little we knew 
about our own schools and schooling. What constitutes an indicator, what to measure, 
at what level, how, how often, arxl how th«^ :^*itts should be used, by whom, remain 
topics of keen interest and debate (Kaagan & Si.... 1985; Oakes. 1986, 1989; Porter. 
1988; Rk:hards, 1989). 

Several researchers have pointed to the need for a comprehensive set of 
measures to guide refomi (Smith. 1989; Oakes. 1989). Anderson's (1982) excellent 
critique and synthesis of school dimate indicators concluded that most existing 
measures of school climate focused on only a few dimensions of school climate; they 
were seldom combined to capture the essence of climate. Others like Cuban (1982) 
warned against choosing reforms from a laundry list of strategies for makir^g schools 
effective without considering the health of the whole enterprise. 

Anderson's (1982) conceptualization of dimate, adopted from Tanguir (1968). 
was useful for klentifying factors v^hich are perceived as shaping a school's dimate. 
The four categories of variables were: ecology (physical facilities and material 
resources); milieu (characteristics or attributes of the indivkjuals in the school); sodal 
system (patterns or rules of operating and interacting in the school); and culture 
(variables that reflect the norms, belief systems, values, cognitive structures, and 
attitudes of persons within the school). Smith (1989) advised thinking of a fully 
functioning system as one made up of three parts: inputs and resources, processes, 
and outcomes. Further he noted that these three components are connected through 
relationships that are direct and indirect, unidirectional and redprocal, and causal. 

The research team endorsed these framewortcs and guidelines, and we 
estak>lished additional criteria of our own. The measures of school climate should 
capture in operational form as much as possible of what is reported in the literature on 
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effective schools. As well as being comprehensive, the measures should tap different 
perspectives. Multiple indicators of the sr/ne variable should be achieved for cross 
validation purposes whenever possible. Indicators of student outcomes should go 
beyond basics. We would not ignore available data on standardized tests of basic 
skills, but we prefen^ed criterion measures of academic ot>jectives which the teachers 
actually taught. Most especially we developed a test to measure higher order thinking 
and critical reasoning in the context of solving realistic problems involving science and 
mathematics. Finally, wa were intent on including measures of prosocial behaviors 
and other positive student outcomes which were non-cognitive in nature. 

Development of Comprehensive Measures of School Climate 

A review of indicators used in previous studies was completed. The review 
included instruments developed by HpJpin and Croft (1963), Stem (1961), Sinclair 
(1970), Coughlan (1970), Brookover et d. (1979), Rutter et al. (1979), Epstein and 
McPartland (1976), and Domian (1986). Suggestions from advisory groups to state 
policymakers (e.g., Goodson, Swartz, and Bronson; Abt Associates, 1987) and 
reconrvnerxlations by Wynne & Walberg (1986) regaroing the assessment of character 
development were also considered. We agreed witti Anderson's (1982) eariier 
assessmerrt; no existing measure which we could locate provided a comprehensive 
view of school climate. Accordingly we set out to develop new instruments which 
woukj measure "irious aspects of school dimate as perceived by the students and by 
the teachers. We preferred to use regular meetings, observations, interviews, and 
infomnal conversations with the principals to assess their perception of and influence 
on school dimate. Quantitative analysis of a sample of four would not be meaningful; 
we also noted that leadership behaviors might emanavi^ from individuals other than the 
prindpal. We considered seriously ways to include the parents' points of view in this 
assessment, but we did not have the resources to do so. 

Parallel forms of tiie dimate sun/ey were drafted, first for the teachers, then for 
the students. The teacher questionnaire was piloted with our collaborators in the 
schools in May, 1988. Wf .olidted their reactions to the instrument as to substance 
and fomi. Suggestions from the advisory board members and continuing review of 
the literature also guided the changos we made, induding the addition of several 
sections and changes in format. Whiie we were interested in achieving a 
comprehensive assessment, we were also mindful of the need for a manageable and 
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parsimonious, as well as useful set of items. The final fomi of the teacher 
questionnaire was administered in May, 1939. It is shown in Appendix A. 

The topics and issues which the teacher questionnaire addresses are listed 

below: 

Demographic Characteristics of the Individual 
Professional Preparation and Experience 
Cun^ent Responsibilities 

Areas and Extent of Involvement in Decision Making 

Collegia) Behaviors Among Teachers 

Perception of Factors Influencing the School's Curriculum 

Professional Values, Their Importance and Satisfaction 

Areas of Success and Priorities for the School's Meeting Student Needs 

Frequency of Use of Various Instructional Methods 

Factors Influencing His/Her Teaching Objectives 

Frequency of Pro and Antisocial Behaviors and Examples of Each 

Ranking of the Teacher's Actual and Ideal Job Responsibilities 

Ranking of What the Principal's Job ShouM Be 

Sources of Satisfaction and Dissatisfaction About Teaching in His/Her School 
Participation in Decision Making 

Participation in Professional Development Outside of BPS Role 
Special Characteristics of His/Her Middle School 
Critique of the Questiornaire* Especially Areas Omitted 

The student version of the School Climate Survey had as many as ten revisions 
and four pilot tests before we anived at its final form in February, 1989. The first pilot 
test was conducted with a sixtti grade dass in an urt)an community adjacent to Boston. 
Additional pilot tests were conducted by two graduate research assiflants who also 
had field placements wortdng with low achieving sixtti grade students in anotiier urban 
school near Boston. The students involved in the pilot tests shared many salient 
demographic and educational characteristics with the eventual sample. With 
pennission from \he host schools, the research assistants told the students that this 
was not a test, but an effort to find out ways to make schools more effective. Students 
were advised to ask questions as they went along, about items and/or words they did 
not understand. Upon students' completion of the questionnaire, the research 
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assistants again asked for points of confusion and noted any difficulties or 
misunderstandings. Their recommendations were incorporated into the successi' e 
revisiorts. 

The Student Questionnaire inquired atxxjt the following topics and issues: 

Demographic Characteristics atxxjt the Individual 
Participation in Any Sped?! Programs 
Mode of Transportation to School 
Reasons for Coming to School 
Life Satisfaction 

How He/She Spends Time Outside of School- 
After School, on Weekends, and during Su .imer 
Participation in Volunteer Work 
Parental Involvement and Regard for School 
important Adults in the Studonf s Life 
Self Report of Grades 

Assessment of the Teacher's, Principal's, and Student's Jobs in School 
Choice of Adult for Help with a Serious Personal Prolsiem 
Clarity of Rules of Discipline 

Rewards and Punishments in the School and How They Are Enacted 
Student's Own Value System 

Frequency of Pro and Antisocial Behavio.3 Observed in School 
Perception of Teacher Behaviors in Relation to School Climate 
Perception of Collegiality arxj Comradely Among All Persons in tiie School 
Perception of Communal Sense of Purpose and Pride 

The student questionnaire was translated into Spanish and Vietnamese, for 
those trilingual groups which were predominant in the sample schools, so that each 
school could choose the version likely to yield high quality data for each of their 
students. At the suggestion of tiie teachers on the advisory board, bilingual teachers 
were available to aid in the administi'ation of the questionnaire to students who had 
limited reading proficiency in any language. 
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Copies of the questionnaires had been delivered to the schools in the required 
numbers in each language version one week prior to the date scheduled for 
administration. Lat>els provided by the schools or the Central Office were pasted to 
the upper right of each copy. The labels identified the students t>y name and by a six* 
digit code which was needed to match each students questionniire responses with 
their scores on various achievement measures. Without the match, only descriptive 
research could be accomplished; with the match, more powerful, causal-comparative 
research was possik)le. 

Students were told by their teachers that the survey was anonymous, but that 
the ID code was needed to match their answers on the questionnaire with other data 
which would also be anonymous (their achievement test scores). Once the matches 
were made, the codes would be destroyed. The students were asked to ink out their 
names, but not the ID number. The vast majority complied with our request, but a 
handful found ways to obliterate any number hekj up to the light. 

Administration was accomplished in each school to the total school population 
on a day chosen by the school. The school based team members had been asked to 
review the procedures with their colleagues. The main offices lent assistance with 
their public address system. The Boston University team and several graduate 
assistants were on hand to answer questions. As announced by the PA system, we 
positioned ourselves on various floors and corrklors to be accessible by the teachers 
to answer questions and respond to any difficulties. 

Cooperation from the schools was outstanding. The rate of returns from 
administration of the student questionnaire virtually equalled the attend^^e for the 
day-80%; the rate of usable returns showed very little attrition. The completed 
questionnaires (with students' names removed and student ID codes for the vast 
majority intact) were taken by the University research team memt)ers back to the 
University where they were picked up for data processing. 

Traditional Measures of Student Achievement 

The Boston Public Schools require the administration of a number of norm 
referenced and criterion referenced tests of basic skills. We did not request additional 
testing which would have duplicated these efforts. Rather we requested tapes of the 
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data for the four schools in our sample schools so that we could conduct additional 
analyses. As agreed in the preliminary phases of planning for this research project, 
the Bureau of Research of the Boston Public Schools provided to the principal 
investigator a tape containing the following information for students in each of the four 
sample schools: 6-digit ID code (to enat)le the match with the student questionnaire 
records); standard scores from two subtests of the Metropolitan Achievement Test, i.e., 
Reading Comprehension and Mathematics Total Scale Scores; scores from the 
Boston Public School System's own Criterion Referenced Test in Mathematics (CRT- 
Math); and final grade.s in all academic subjects: Reading, English, Mathematics, 
Science, and Social Studies. (Grades in Health for seventh graders only were 
included on the tape but these could not be used due to the high number of missing 
cases.) 

The Metropolitan Achievement Tests were administered during the second week 
of May, 1989; the CRT-Math was given in June, 1989. Teachers assigned final grades 
during the last week of June, 1989. The bases for their grades were said to include 
test, quizzes, homework assignments, class contributions, and special projects. 
However, this could not be confirmed, and teacher idiosyncrasies in grading were 
assumed to be the case. The only final grade which had some system-wide 
consistency was said to be the grade for English which had to include 20% 
consideration given to student's perfomiance on a writing sample. 

The tapes were to have been made available to the principal investigator by the 
beginning of July, 1989, however they could not be obtained until the middle of 
October, 1989. The unit which needed to score the tests and assemble the data tapes 
for us had to devote all of its staff, full-time, to the problems of the new student 
assignment plan. The B-^ston Public School System had not experienced such 
difficult times since the cojrt ordered desegregs^on years of the middle I970's. 
Controversy over the new student assignment plan was heightened by projected 
budget deficits and the Boston School Committee's approval of the Superintendent's 
plan to dose several schools and consolidate others, without public hearing. The 
plan was invalidated by one court, then reinstated by an appeals court. 
Implementation fell first to the School Department's Office of Infomnation SysteiTis, 
whose services were needed to ot>tain the test data. Research was not their top 
priority. 
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A Measure ot higher Order Thirtking 



A measure of higher order thinking called Test of Problem Solving Skills 
(TOPSS) was developed by the principal investigator for the evaluation of Unified 
Science and Mathematics for Elementary Schools (USMES). an interdisciplinary 
curriculum whose development was sponsored by the National Science Foundation 
(Shann, 1976, 1977a, 1977b). Targeted for administration to students in grades 4 
through 8, the original, 46-item TOPSS had internal consistency reliability of .86. It 
yielded scores vi/hich showed predicted inaeases in skills over grade level, and was 
further validated against teacher judgements of their students' abilities in problem 
solving in a national sample of 40 schools from 18 states. 

The original TOPSS measure was revised and shortened to become TOPS. 
Test of Problem Solving, according to the recommendations made in the previous 
study (Shann, 1976). The language was updated. Children's names and surnames 
were varied to reflect the predominantly black and Hispanic student enrollments in the 
sample schools of the present project. The revised edition of TOPS contained five 
items each on the following topics: 'Pets in the Classroom;* *Bike Transportation;" 
The Window Sill Garden in Mrs. Jackson's Class;* and 'A Busy Comer.* The final set 
called 'A Classroom Temperature Chart ' contained six liems. Internal consistency 
reliability for the 31-item test was .85, based on 972 usable returns from the four 
schools of the present sample. 

TOPS was administered the last week of March, 1989 in each school by the 
toachers during students' science periods. Since these periods varied, we were not 
able to collect data from the entire school at one time, as had been the case with the 
student questionnaire. Students answered the TOPS questions using a machine 
scoreable an.«wer sheet which was preceded vVith their name and 6-digit ID code. The 
format was familiar because it was the same form which the system used for other 
tests. 

While the number of usable returns was substantial, at 972, it was significantly 
k}wer than 1583, the number of usable returns from the student questionnaire. Most of 
the attrition was attributable to two of iiie four schools. In one of these schools, the 
teachers felt that TOPS was too difficult for many of their students. The other school 
changed its procedure for gaining parents' or guardians' pennission for testing. In the 
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case of the student questionnaire, which was administered first, the school, using our 
suggested form letter, notified parents that administration had t>een scheduled, and if 
they did not wish their sons or daughters to participate, they should notify the school. 
Very few objected, but one was loud in her criticism-rafter the fact. For the 
administration of TOPS, the principal decided to collect signed permissions from 
parents and allow only those students wtx) returned slips to take the test. (When ihis 
story was told six months later to the new principal in that school, he knew 
immediately who the parent must t>e. He was correct.) 

We had also requested that teachers rank order their students in these classes 
witii respect to the students' problem solving skills; we asked that the teachers do this 
while their students were taking the test. Two schools forgot to give thi rating 
instructions to the teachers, and the data could not be reclaimed at a later time. 
Intrusioi^s on the schools' schedule had become more and more numerous, especially 
for testing, and additional requests of teachers were not advised. 

The Elusive Student Head Count 

Determining the return rates and completion rates for ail available measures of 
student achievement was important for assessing the representativeness of the data 
base for the study. However, confirming the total number of students enrolled in each 
school proved to be problematic. School officials quoted numbers from their records, 
and these figures were generally consistent with the number of full time equivalent 
(PTE) students reported in the School Profiles 1988-89 published by Boston Public 
Schools Office of Research and Development. Yet, if the PTE figures are corect, ti le 
schools have missing achievement data for significant percentages of their studenis 

As refiected in Table 2.1, the complement of the student data base varies by 
school and by the particular measure of data collection. Even in School 1 , whose 
records are most complete, final grades are consistently reported for only 83% of the 
declared number of PTE students. Arguably, the numt>er of final grades assigned in 
the major subject areas of mathematics and English provide the most accurate gauge 
on the numt)er of students actually participating in the schools' programs. "Hard core 
absentees" and transfers too new to grade would be eliminated fi^om the count, but the 
number would reflect those students who are absent occasionally, whereas the test 
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measures collected on a single day can be no higher than the attendance rate for the 
day. 

The usable return rates for the Student School Climate Questionnaire compare 
favoratsly to the rates for other data, both test scores and final grades, which the 
schools collect for themselves. The return rates for the questionnaire were 
consistently highest of all measures. Usable return rates for the Test of Problem 
Solving were judged to t>e adequate only for Schools 1 and 4 which were two-thirds of 
the PTE and 80% of the questionnaire completion rate. The completion ra*9S for TOPS 
in School 2 and 3 were 21% and 35% of the respective PTE's, indicating 
nonrepresentative samples for those schools. 

The data in Table 2. 1 suggest that the reported PTE's may be inflated. The PTE 
is conr^ed to reflect the percentage utilization of each school's stated capacity. It is 
an important figure because resources are allocated according to PTE's. However, 
varying attendance rates as well as admissions and transfers render the enrollment 
picture a moving target. 

Interviews with Teachers 

The 'point person' for each school-based team through whom we addressed our 
requests and responses to each school and scheduled dates for data collection was 
usually the Oirecto" of Instruction, a position at the level of vice-prindpai. It was this 
person who helped to identify teachers willing to be interviewed by a member of the 
university-based team, who also represented a cross-section according to the 
following attributes: grade levels taught, responsibility for regular instruction versus 
special programs, gender, race/ethnidty, and years of experience teaching. We 
sought first three teachers at each grade level and three teachers of non-graded or 
special programs which cut across grades, or 12 teachers per school. If teachers 
selected for interviews could reflect variat)ility on the remaining factors-gender, race, 
and experience~we asked that they be considered as well. 

The list of teachers willing to be interviewed, their availability before, during, or 
after school, and their preferred telephone numbers, home or wori<, was otTtained by 
the project coordinator. Members of tho research team scheduled interviews with 
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each teacher individually, according to the information supplied. Typically, each 
interview lasted 45 minutes to one hour. Only the broadest of guidelines were used to 
structure the intemew: 'What do you like most about teaching in this school? What 
would you change?' Few prompts were need ^ror these teachers to say what they liked 
and dkJn't like about their schools. Interviewers, as much as possible, took /erbatim 
quotes but without audio tape. Notes were transcrit>ed immediately and circulated 
among other members of the team who were also conducting interviews. Periodic 
analyses of the interview results and the success of the format took place at meetings 
of the project staff. 

Interviews with Principals and Other Administrators 

Formal 'interviews' were not scheduled with the administrators, txjt in fact a great 
many interviews with these people took place over the course of the project. We 
listened to their vision for the school, their concerns, their plans for undertaking 
reforms, and their assessments of how well things were going, and why. 

Observation 

Frequent site visits afforded numerous opportunities for informal observation In 
the 5Chools. In particular we were able to note interactions between administrators, 
between acbninistrators and teachers, and among teachers. Since ours was not a 
study of dassroorn level teaching and learning practices, we had limited opportunity to 
observe students in classrooms, but we were able to monitor student behavior In 
common areas of the schools, like the lobby, com'dors, cafeteria, auditorium, and 
grounds. 

Two of the graduate research assistants developed forms for recording the 
allocation, condition, and use of space in the school building as well as the condition 
of the exterior and use of outskje grounds. The forms constitute unobtrusive measures 
which take evkJence from the physical objects and the school buikling itself to infer 
how people use that space and what they care about. 

A photographic record of the physical space was also attempted for each school. 
Ir particular we wanted to capture on film ways in which the schools praise their 
students' accomplishments in academics, art, sports, or other endeavors. While this 
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TABLE 2.1 

Student Data Base by School and Grade for Each Measure of Data Collection 



SCHOOL School 1 School 2 



DATA/GRADE 


Gr6 


Gr7 


Gr8 


Total 


Rale* 


Gr6 


Gr7 


Gr8 


Total 


Rate* 


Declared 'FTE''> 


288 


236 


216 


740 


100% 


233 


184 


177 


594 


100% 


Questionnaire^ 


244 


203 


184 


631 


85% 


182 


121 


111 


414 


70% 


MAT Reading<^ 


213 


175 


168 


556 


75% 


115 


70 


58 


243 


41% 


MATMathd 


213 


179 


161 


553 


75% 


114 


69 


58 


241 


41% 


CRT Math» 


155 


162 


135 


452 


61% 


132 


89 


80 


301 


51% 


TUPS* 


206 


158 


132 


496 


67% 


68 


16 


43 


127 


21% 


FGo Reading 


238 


196 


179 


613 


83% 


82 


66 


65 


213 


36% 


FG Math 


239 


197 


178 


614 


83% 


180 


117 


103 


400 


67% 


FG English 


239 


197 


179 


615 


83% 


179 


119 


104 


402 


68% 


FG Science 


216 


74 


179 


469 


63% 


180 


119 


105 


404 


68% 


FG Soc. St. 


239 


197 


179 


615 


83% 


179 


118 


104 


401 


68% 



'Rates are the number of usable returns as a percentage of the declared 'FTE*. 

bjhe udctarad FTE' is the number of 1011 time equivalent students raportedly enrolled in the school, 
as detemiined by the schoool's seating captcity times the estimated percent utilization (Boston Public 
Schools Profile 1988-89). 

^he School Climate Questionnaire was administered to students In March, 1989. 
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TABLE 2.1 (cont.) 

Student Data Base by School and Grade for Each Measure of Data Collection 







School 3 






School 4 




All Four Schools 


Gr6 


Gr7 


Gr8 


Total 


Rate* 


Gr6 


Gr7 


Gr8 


Total 


Rate> 


TOTAL 


Rate* 


94 


99 


79 


272 


100% 


129 


119 


135 


383 


100% 


1989 


100% 


79 


80 


60 


219 


81% 


112 


98 


109 


319 


83% 


1583 


80% 


56 


65 


48 


169 


62% 


108 


94 


108 


301 


79% 


1278 


65% 


ss 


66 


47 


168 




1 WW 


93 


106 


302 


79% 

/ w /O 


126^, 


64% 


51 


54 


31 


136 


50% 


90 


82 


83 


255 


67% 


1144 


58% 


26 


27 


42 


95 


36% 


91 


78 


85 


254 


66% 


972 


49% 


75 


75 


57 


207 


76% 


86 


35 


20 


141 


37% 


1175 


59% 


79 


78 


60 


217 


30% 


111 


97 


108 


316 


83% 


1548 


78% 


79 


78 


56 


213 


78% 


47 


97 


108 


316 


83% 


1484 


75% 


78 


78 


57 


213 


78% 


93 


30 


77 


250 


65% 


133: 


67% 


77 


75 


60 


212 


78% 


14 


4 


16 


34 


9% 


1263 


63% 



^MatropclKan Achiavenrwrit Tests were administered in May, 1989. 

*The Criterion Referenced Test in Mathematics was administered in June, 1989. 

^The Test of Probiem Solving was administered in April, 1989. 

9PG denotes final grades which were assigned in June, 1989. 
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was also noted through assemblies, public notices and newsletters, the use of film 
helped us to document trophy cases, honor rolls, art exhibits, displays of students' 
work, and other stat'^ments celebrating what the students have achieved. Negative 
evidence also commanded the attention of the photographer, like misspelled graffiti. 

Indicators from the Running Records of the Schools 

In addition to the questionnaire responses, test scores, interviews, and 
obsen/ational data, general indicators of student health and well - being were also 
sought: rates of absenteeism, truancy, drug abuse, pregnancy, incident reports, and 
vandalism-on the negative side— but also positive outcomes as well: citations for 
exemplary behavior; volunteer work; student - initiated repair, clean-up or other 
improvement projects; participation in peer counseling; peer teaching; cross -age 
tutoring; or any school-based community sen^ice or school improvement project. Many 
of the negative indicators were available from the running records of the schools: 
some are published annually in the Boston Public Schools Annual Profiles. Indicators 
of the positive outcomes were built into the student and teacher questionnaire. 

Summary 

University/school collaboration in the conduct of this research was envisioned 
from the start. The thrust was to develop valkj, practical indicators which can capture 
information atxsut school climate which the research literature has demonstrated is 
relevant to student achievement. We sought results which could be used to infr^rri 
educators and policy makers about school level practices which need to instituted or 
changed to promote student achievement 

The definition of student achievement was broadened to include not only 
perfomiance on standardized tests of basic skills k>ut also higher order thinking and 
problem solving, as well as prosodal behavior and community sen/ice. 

Student and teacher questionnaires were developed in collaboration with 
educators in the schools. They were designed to yield comprehensive portraits of 
school climate, including the people and their attributes, the social system and its 
patterns of relationships and interactions, and the culture of the school, including the 
norms, values, and beliefs reflected in the behavior of its members. Teacher 
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interviews and observation were used to complement and cross-reference the data 
obtained from the previous sources. 



Teacher questionnaires were administered at a time when teachers were 
occupied with demands for system wide testing arxJ other end of the year activities. 
Many teachers were worried atxxjt lay-offs, and moiale was low, in some schools 
more than others. Against these odds, the rate of return for teacher questionnaires 
was approximately 50%. The student questionnaire was administered earlier, in 
March, 1989, with outstanding cooperation from the teachers and administrators in the 
schools. The retum rate equalled the attendance rate for the days of administration, 
80%. In fact, we had a larger response rate to the student questionnaire than the 
Boston Public School had for its grade and test files on the students in the sample. 

The usable number of cases for all student instruments and measures are listed 



below: 



School Climate Survey 
MAT- Reading 
MAT-Mathematics 
CRT-Mathematics 
Test of Problem Solving 
Final Grade in Reading 
Final Grade in Math 
Final Grade in English 
Final Grade in Science 
Final Grade in Social 



1583 
1279 
1265 
1145 
972 
1175 
1548 
1484 
1337 
1263 



Studies 
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CHAPTER 3 



THE SCHCXDLS AND THE STUDENTS THEY SERVE 
by Margaret W. Rum and Mary H. Shann 

The four middle schools in the sample are described using information 
collected about each school on each of the following aspects: the buildings and their 
neighborhoods; resources available to the schools; the principals, the student 
populations, and their teachers; and finally, the school activities, both :urricular and 
extracurricular. Data were gathered from dty records, newspapers, inten/iews, and 
observations over three years. All of the schools were a part of the same school 
district, under the same superintendent, in the same school system, teaching the same 
grades and drawing from a similar pool of students and teachers. While they were 
similar in many respects, there were important differences too. 

School 1 

The Building and Its Neighborhood 

Neighborhood 1 was *home' to over 46,000 people. It contained every typical 
Boston housing type from triple-deckers to suburban-style ranches and included one 
of Boston's largest public housing projects as well as the city's only working farm. 
Sun^ounded by the open spaces of Frederick Law Olmstead's "Emerald Necklace,' 
Neighborhood 1 has become an integrated community of black, white, and Hispanic 
home-owners without the widespread abandonment that often accompanies a change 
in the racial and economic structure of a neighborhood. 

The future of Neighborhood 1 would seem to be bright. According to data 
provided by the city's research bureau, growing numbers of new homebuyers have 
been attracted to the neighborhood by its abundance of two and three family homes. 
The incorre producing capacity of these multiple family structures were becoming 
more attractive in an era of perennially high housing costs. The new buyers were 
often childless, working couples or singles, d*^awn to the area by its quiet 
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neighborhoods. I'^w crime rate and accessibility. The completion of the new Orange 
Line rapid transit system in 1987 continued to increase the area's desirability, 
threatening to displace low-income and elderly residents who are unable to meet 
increasing housing costs (Boston Redevelopment Authority. 1988). 

School 1. built in the 1930's. was located c < .ajor dty street of one of 
Boston's most diverse residential neighborhood? ' .. plot plan, the school would 
have resembled a capital T. the st-iort bottom lir;e oi .vhich was the front facing the 
street. The architecture of tiie facade of the three-story, orange brick building, divided 
by ornamental stone pilasters, was simple and belied its enormity. The school 
covered roughly the area of a city block. Over 700 students were served by 60 
teachers. 4 administrators, and several support staff. Offices of the district 
superintendent arxl her staff were housed in the rear section of the building. 

A Veriaal Snapshot 

Inside. School 1 hummed with human activity, echoing the hum of the street 
outside. On a gray Wednesday morning in February, a student activity board in the 
foyer proclaimed: February is Black History Month.' Another display pasted with 
photographs was entitled 'New England Baptist Hospital. Our Business Partner.' A 
bust of tiie school's namesake was centered at the top of a short series of steps in tiie 
pleasingly proportioned foyer. To the right of the steps was the office. Phones rang. 
Students and adults moveed rapidly in and out and behind the high recuption counter. 
Papers and kx)oks vere on every surface. It seemed to k>e chaos, yet there was an 
internal order not visit)le to the observer at first glance. A display of Valentines hung 
on the wall opposite a lush green hanging plant. The seaetary welcomed a visitor with 
an offer of coffee and directions. 

The main hall lined in tile and brick, ran along the front of the building. 
revert)erati'ng with sound. Colorful, aeative activity boards enlivened the walls. The 
Honor Roll was represented by a pipedeaner marching t>and holding banners with 
homerooms and honored students. Another poster portrayed School 1 as a 
comfortat}le room with a large bas-relief paper fireplace. Above the mantie hung small 
pictijres of tt^e adminisfa'ati've staff. The teadiers' names with homeroom numbers 
were listed beside tiie fireplace. 
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The classrooms were arranged with the sixth grade and the advance work 
dassrooms located on the first floor. Above these room on the second floor, were the 
eighth grade rooms. Along the stem of the 'I' were seventh graders, bilingual and 
regular students, in altemating dassrooms fbr 'integration.' On the lower floor, below 
the first floor, were the cafeteria, resource rooms. Office of the Oiredor of Instruction, 
and the spedal education dassrooms. It was lunchtime. and students were eating 
and talking at small picnic-styled tables. The cafeteria was colorful and noisy, void of 
any acoustical ceiling. Two teacher monitors watched over the half-hour lunch 
periods. 

Resources 

Maintenan a was a chronic challenge; there were occasional broken windows, 
torn saeens. and scuffed walls. A student campaign to dean and paint walls has 
reduced graffiti from bathrooms and halls. Basic maintenance and repairs were 
provided by the Boston Public Schods; however, teachers and staff, with student help, 
often painted rooms and halls, and d«d minor repairs. 

Schod 1 was supplied with the tsasic resources needed for teaching-books, 
paper, pendls, etc. -by the Boston Public School System. Other resources such as 
computers and office equipment were often ot>tained through one-time requests to 
granting agendes and specific businesses, or through on-going business 
partnerships. One teacher commented- 'Resources are very limited. I don't even 
have enough books for my dasses, so we only use the textL<^)ks in dass. Sometimes 
I think that funds get allocated or misallocated to those who push the hardest, but it 
shouldn't be that way. Also. I think that in-service workshops on proposal writing 
would be helpful to us. Why not train us to get the funds we need.' 

The prindpal. always alert to opportunities for acquiring additional resources, 
constantly tried to get the things, people or programs needed at the schod. At School 
1. she arxi the teachers assessed each prospective cdlatxiration for its potential in 
contributing some needed resource to the schod. Ours was no exception. At the first 
meeting of th<) University researchers and School 1 administrative te2.m. a list of 
potential resources was presented by the school representatives: free courses at 
Boston University, use of ttie University's educational professionals in appropriate 
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ways, and service by one of the University-based researchers on School 1's Action 
Team. 

The administration actively solicited and was successful in developing many 
collaborative ventures. In a booklet prepared for the National Dropout Prevention 
Conference in April, 1989, School 1 boasted continuing collaborations with these 
organizations: Student Human Services Collaborative (since 1984); Boston Partners 
In Leaning (1984); Sea Ventures (1984); Boston Ballet (1974); Good Neighbor 
Program (1984); Boston Area Health Education Collaborative (1984); Black Achievers 
(1985); Project Commitment (1985); Freedom from Chemical Dependency (1985); 
AIDS Action Committee (1986); SPECDA Drug Program (1986); Animal Rescue 
League (1985); Alianza Hispana (1985); Museum of Fine Arts (1985); Museum of 
Science (1974); Ecumenical Social Action Committee (1980); Massachusetts 
PreEngineering Program (1985); and Regional Laboratory Dropout Program (1987). 

The Principal 

School 1's principal was an energetic black woman who has been pri.ncipal 
there for about 10 years. Asked if she had children, she replied, 'Yes, I have 700 
children,' referring to the school's student population. The statement also said 
something about the level of her involvement at School 1 and her leadership style. 
She exhibited a very personal, hands-on management style. A firm believer in school- 
based management, she willingly delegated authority and tried to share decision- 
making with her staff, sometimes becoming impatient when the process moves too 
slowly. 

Her day at the school began at 6:30 a.m., often not ending until 9:00 or 10:00 
p.m. She instituted evening events for parents and insured regular parental 
attendance at least several of these meetings by using the events to hand out 
students' report cards directly to parents. She began plans for more community 
involvement and planned a series of dialogues on issues of common interest. Ever 
alert to grant possitxlities, she maintained an impressive record of external funding. 
Her school had just received a $474,000, two-year grant from OfTice of Education for 
Dropout Prevention Program. The school was featured at the National Dropout 
Prevention Conference in San Diego in April, 1989. 
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The Students 

Data were collected in 1989 from 627 of School 1's approximately 700 
students. Reporting their race/ethnidty, 55.8% said they were Hispanic, 30.3% black, 
7.2% white, 2.4% Asian, and 4.3% Native American or other. A wide range of 
ages, from 10 to 18 years, was reported the students: less than 1% said the were 
10 years old, 12.8% reported being 11 years old, 25% said 12, 30% said 13, 22.5% 
said 14, 8% said 15, 1% said 16, and less than 1% said they were 1 8. 

School 1 had more male than female students, with 52.6% of the students 
reporting male and 46.3% checking female; t.1% did not respond. Just over one-third 
of the students reported that they walk to school, suggesting they lived jn the 
neigi tbortTOOd; 29% reported they go by bus; 18% by 'The T ' (public transit), and 17% 
by car. 

Studerrt turnover affected about 200 students during the year, or about 28% of 
the student body. School 1 reported changes in student enrollment as follows: now 
BPS admissions -59; BPS transfers in -- 77; and BPS transfers out - 88. Of these, 69 
were discharged to other school systems, one dropped out, and 22 were unknown. 

Students were assigned to various programs in the school by central 
adn^iinistration: advanced woric class for better sixth grade students; spedal education 
and Chapter 1 remedial classes for students reading below grade level; and bilingual 
classes for students for whom English is a second language. Most students in regular 
education are grouped by Metropolitan reading test scores. 

If Scnool 1 was typical of most middle schools in the system, it reflected the 
following practices: 

For most students, reading scores determine their sixth grade placement- 
math scores have little bearing. Once placed in homeroom dusters, many 
Boston middle grades students remain with their homeroom classmates for 
the entire year. Regardless of variations in their mastery of aifferent 
sutyects, students typically attend all academic classes with their same 
classmates, although they may mix with others for gym, art, or music. 
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Dedsions about duster assignments generally rest with the school staff and 
tend to t)e permanent; only one student we interviewed reported that she 
had been moved into a 'higher' duster and this occurred only after her 
mother per^sted in seeking a charge" (Massachusetts Advocacy Center, 
1990). 

On the topic of student assignment, a teachsr commented, 'I would like to 
change the procedure for placing the kids. I just don't believe that the tests are 
accurate for placing students. I think the dusters (teacher/student units within the 
school) and the principal should decide.' School 1 reported 432 in regular 
education, 217 in Bilingual program, 160 in Special Education, and 36 in Advanced 
Work program. 

Atx)ut the students, one teacher said, Tm very interested in tapping into their 
potential and applying what they have in their work here. I believe that social studies 
taps into culture and can expand their horizons by reading about other people. But 
here we spend far too much time disciplining kids. I am impressed, however, with the 
racial balance of the school. We have Hispanics, blacks, and whites with only 
occasional little flare ups.' 

Another teacher said, 'I enjoy, no, I love the kids. I love to see them learn and 
have success. But kids are starting to believe that eighth grade graduation is the only 
one they are going to get. They come all dressed «jp- limousines, gowns. Every kid 
should achieve success and feel good about themselves, but they have to have twelfth 
grade as a target, not eighth grade.' 

'I enjoy working with middle school kids. They're half child and half adult. They 
can be charming and very pleasant, but working with them is both exciting and tiring. 
You have to learn to be parent, friend, and counsellor as well as teacher. We need to 
have expectations of them, so that they can have expectations of themselves. I'm tired 
of people making excuses for students. We can care, but we cannot give up on what 
they can become, despite the difficult obstacles they face,' said a bilingual special 
needs teacher. 
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The Teachers 



The 60 teachers in School 1 were assigned by grade and by speciality. They 
were organized in a new cluster system, meeting weekly to discuss their work, the 
students within their cluster, and to coordinate the activities. This common planning 
time was a new initiative of the principal. One teacher reported, 'Clusters are a good 
idea. There are several teachers, five or six, for about 125 to 150 kkis. Ifs a good way 
to discuss the kids and the progress they're making.' The five clusters were: sixth 
grade, seventh grade bilingual, seventh grade, eighth grade, and advanced work. 
Special education was a separate group. 

Of the 48% of the teachers responding, 58% reported teaching at School 1 for 5 
years or less; 25% from 5 to 10 years and the remainder from 10 to 22 years. School 1 
reported its faculty's radal-etiinic composition as 57% white, 23% Hispanic, and 20% 
black teachers. Of the respondents, 55.2% were male, 44.8% female. Fully two 
thirds reported having an advancrd degree. 

The School Schedule and Activities 

The regular school day was divided into seven periods-five academic, one 
homeroom, and one reading period called DEAR-Drop Everything and Read (formerly 
called USSR before glasinost or Uninterrupted, Sustained, Silent Reading). School 1 
had only two bells; at 7:40 for homeroom and at 8:00 a.m. to announce ttie first class 
Classes changed on the hour from then on and were approximately one hour long. 

After school activities included basketiDall and a few dubs. School 1 had an 
annual Talent Show and Faculty/Student Basketball Game. Students helped with the 
evening supper meetings for parents and oti^er special evening events. Enrichment 
field trips have included the Boston Ballet, the Gardner Museum and Thompson's 
Island. 

One teacher's view of ti^e school's activities was ti^at 'There's not enough room 
for extracurricular activities like band, cheerleading, and aerobics. Our kids don't 
know how to play with each other. They have never learned how to interact. They 
come to dass and sit. They need to learn how to be togettier. dance, sing, act. They 
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never have time in the school to do these things. Some classes have such activities 
txit they are added in as if they were second rate. The day for a kid is dull, kids are 
kx>red to death. The kids aren't supposed to talk in dass, or in the halls. They have 
NO RECESS. Its like a prison barracks. Middle schools need to change, and try more 
innovation. Changes couki draw the kids in, and k>e the reason they come. We could 
save them.' Another said, ' Students need more afterschooi activities. Too many 
students go back to empty homes. It's unfortunate that schools have to take on the 
parents' responsibilities, but the parents just arent there for some of these kids.' 



SCHOOL 2 



The Building and Its Neighborhood 




carved high atop the central white stone facade, announced the tHJilding's name: but 
its massive presence needed no introduction. The large stone and t)rick school 
completely dcminateed the narow tree-lined resklentia! street it inhabited. The white 
center sat sphinx-like with its great stone paws guarding the two tiers of steps rising up 
to the massive pairs of glass and iron grille double doors. This was the entrance to the 
school's main floor which was a full story above ground. 

Stretching out from the center were two identical 'L' shaped brick wings that 
spread for half a city block in either direction. Each wing was finished with a white 
stone facade and glass and grille doors, echoing the main entrance. These side 
entrances were used by the students coming by bus and on foot at the start of the day. 
Girls entered through the doors in one wing, boys ttvough the other wing. They went 
directly to the cafeteria where they sat, segregated by sex, on either side of the large 
room until they were sent to homeroom. The lofty main entrance was used ' 'y by 
tardy students and visitors. Man-size verdigris torchieres at each entrance reinforced 
the building's sense of importance. No plantings softened its strong architectural lines. 
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The area in which School 2 was located was Boston's largest, most populous 
neighborhood. The area's population in 1980 was 65,264 or 11.6% of Boston's total 
population. Large groups of Irish, Italian, Greek and Jewish populations have been 
joined by Chinese, Blacks, and Hispanics in the district's residential areas. 
Neighborhood 2 has become one of the City's best integrated and most diverse 
.neighborhoods. However, half its households contained single residents, and another 
quarter were composed of unrelated individuals. High concentrations of elderly, 
college students and working dass families have combined to present a wide range of 
lifestyles, the majority childless (Boston Redevelopment Authority, 1988). 

A Verbal Snapshot 

Built in the 1930's, School 2 was located on a small, quiet street in a residential 
neighborhood. Across the street, modest, well-kept one- and two-two family houses 
faced the school like Lilliputians watching a silent giant. And the school was silent. 
The time was 9:30 a.m. on a Friday in February. No life coukj be seen at the windows, 
doors, in front of, or around the school. Inside, there were about 450 students, 42 
teachers, 4 administrators, and a handful of support staff. Where was everyone? 

Entering School 2 was mysterious. The great front doors were locked. There 
was a small doorbell to the right. It wori<ed. A young woman appeared and admitted 
the visitor after proper identification was given. Inside the doors was a high vaulted 
foyer. One dusty activity board high on the side wall prodnimed 'A Graduation Motto.' 
Another was blank. A trophy case sat in the comer. To the right was what was once a 
reception room now furnished with an empty desk. Straight ahead, through more 
doors, a dark hall stretched from left to right. Ahead were doors to a large auditorium 
complete with stage and permanent seats. There was still no sign of life, no sound. 
The halls were lined with doors leading to the classrooms, storage areas, etc. 
Upstairs, the second floor copied the first with its long hall of doors, dark wood, and 
dun-colored tiled floor. The doors opened and the students pass silently single file 
along the hall walls. Teachers facilitated the orderly passage. No talking, no 
sodalizing. Order was the order of the day. 

General maintenance was provided by central administration. School 2 
appeared to be dean and in relatively good repair. One teacher reported, 'There is no 
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vandalism, no graffiti here, and it's safe'; however, she complained, with other 
teachers, about the lack of paint and poor general maintenance. They t^lamed lack of 
funds available to the system for this situation. 

Resources 

Like School 1, this school was supplied with bask: teaching resources by the 
Boston Public School System but there always seemed to be shortages, as in the 
other schools. Echoing many teachers, a bilingual teacher reported a shortage of 
books and workbooks; she also wished they could hire more front office staff who 
spoke Spanish, who could talk to parents and facilitate educational processes. The 
administration here actively solicited resources and funding from the business 
community and local institutions as well as government agencies. 

The Principal 

Schoni 2's priricipal, a white man in his late fifties, whose entire professional 
career was spent in the Boston Public Schools, effected a highly democratic 
leadership style, seeming to rely heavily on teachers, parents, and central 
administration for guidance and approval. He had succeeded a series of principals 
who sen/ed briefly after the 'onger tenure of a strong, dynamic leader. Although this 
was his second year as principal of School 2, he appeared to be cautious and careful. 
His manner was friendly and accommodating. 

One teacher reported, 'In general, I don't think the administration is doing 
anything different from the administration of other middle schools. It's just that we are 
lucky to have such responsive and responsible students. These kids are really very 
well behaved for children their age. Safety is never a problem here. The 
administration, however, should be commended on getting teachers who care and on 
creating an environment in which we feel like we can teach. The administration is very 
supportive of teachers. They are understanding of personal problems which 
sometimes come up. ' 

Order and structure in the school were a top priority of the principal and his 
assistant administrators. They've done a great job at providing structure in the school. 
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I think the kids know what Is expected from them. Although teachers have hall duty 
during the changing of classes, students are almost always orderly. The staircases 
are mart(ed with up and down signs. The fire drills are never a prot>lem because the 
principal talks to the entire school about fire drills a^. the beginning of the year in the 
cafeteria,' a teacher sakj. 



The Students 

Of School 2's approximately 420 students, 397 provided usable responses to 
our questionnaire. Regarding their race/ethnidty, 24.4% sakj they were Asian, 25.7% 
black, 10.8% white, 33.2% Hispanic, and 5.8% 'other.' These data showed a more 
radally balanced student body than School 1. The age range, from 10 to 16 years of 
age, was similar to that for School 1 . Students in School 2 reported the following 
ages: less than 1% said they were 10 years okj;13% were 11; 24% said 12; 30% 13: 
20% sakJ 14; 10% 15, and 1.5% said 16 years oki. Like School 1, School 2 had a 
larger male population; 59.2% percent of the students respondents reported they were 
male; 40.8% female. 

The majority of students at School 2, 58.2%, reported that they came to school 
by bus; 16.2% came on 'The T' and 9.2% came by car. Unlike School 1 , 15.9% walk 
to school, suggesting the great majority of the students live outside walking distance of 
the school and outside the neighborhood. 

About 33% of the student body changed during the year. Boston Public School 
Profiles for 1989 recorded 39 new BPS admissions; 55 BPS transfers in; ana 54 BPS 
transfers out . Regarding student losses it was reported that 53 left to go to other 
school systems, six dropped out, and five were unknown. 

As was the case for School 1 , School 2 offk:ials reported that students were 
assigned to bilingual education, special education, and advanced wori< classes by the 
central administration. Students in regular education were assigned to classrooms 
based on their MAT reading scores. As reported by students, their enrollment by 
program was: 18.9% regular education; 23.9% bilingual education; 35.0% special 
education including Chapter 1; 10.3% advanced wori< dass; and 11.8% combination 
of biiingual and spedal education programs. 
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Whnn asked what do you lik» best about this school, one teacher said, ' The 
students here are great. They're just likeable icids to work with. The kkJs really respect 
their teachers. They respect each other. There's a real mix of kids here - Asian, 
wNte. black. Hispanic. Once in a while, you might catch a racial slur or two. but I 
always take the kid askje and talk to him. Actually, there seem to be more problems 
within the racial groups than across race lines.' Another teacher said. The kids! I love 
them.' 



The Teachers 

The 42 teachers at School 2 were newly organized in dusters, but 'not pure 
clusters,' meaning some teachers are members of one cluster and teach some 
students in another cluster. The clusters were: bilingual-Spanish; bilingual- 
Vietnamese, sixth grade, seventh grade, eighth grade, and two 'learning adaptive' 
clusters. A teacher reported, 'The duster system meets weekly with administrators, but 
is teacher-led. At the duster meetings, the needs of the kids, evaluation, etc. are 
discussed. This is good communicatk>n and very important.' This weekly meeting 
was the teachers' only common planning time. 

Only 33% of the teachers in School 2 provided usable questionnaires. An 
additional 15% responded to an old fomn from an early pilot test which they had 
received from a school representative. Of those responding, 64% reported they had 
been teaching at School 2 for 5 years or less. The remaining ranged from 5 to 25 
years. The race-ethnic composition of the faculty of School 2 was: 65.8% White, 
14.6% Black, 10% Asian, and 10% Hispanic. The respondents reported tSiey were 
92.9% female and 7.1% male, unlike School 1, which had a more oven gender 
distribution and a more representative rate of return. At School 2, 64.3% of the 
teachers held advanced degrees. 

Commenting ab3ut her peers, one teacher reported: The teachers are here to 
teach. As far as I know, they're good at what they do. I believe 90% of the teachers 
like what they io. Although I've been here for four years, I haven't found the time to 
sodalize with other teachers. We are professional with each other, but in a respectfJ, 
distant manner. I don't want you to get the idea that the teachers here are a cold. 
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achievement-oriented bunch. We are often too busy wori<ing on bettering our 
materials for our kids. For instance, I spend many of my lunch periods here in my room 
planning lessons or correcting student wort(. We, however meet weekly in dusters. I 
find this time very helpful and productive.' 

School Sc. ledule and Activities 

The regular school day was divided into 8 periods with no flexibility of 
scheduling. They were: 5 academic, 2 electives, and 1 homeroom including 'USSR' 
(uninterrupted, sustained, silent reading). At least one teacher would like to see 
longer dass periods. 'I cannot conduct a sdence dass in 45 minutes. Two periods 
two or three times a week would be better than having one period each day.' School 
began it 7:40 and ended at 1 :40. 

The afterschool programs induded: help in reading, computer dub, basketball, 
and mod( trials, 'i d like to see more afterschool programs. Right now, the afterschool 
program consists of informal activities and ends as soon as the late bus arrives to take 
the kkjs home,' said a teacher. A late bus came at 2:30 but was 'not predictable.' 



SCHOOL 3 



The Building and Its Neighborhood 

Neighborhood 3, in the geographic center of Boston, was one of the dty's most 
historically significant areas. Once an affluent suburban area, the neighborhood grew 
more densely populated around the turn of the century when streetcar service was 
extended from the downtown. The area has experienced extensive abandonment and 
disinvestment in both its commerdal and residential sections. As the incomes of 
successive waves of new residents decreased, maintaining businesses and the 
existing housing stock became increasingly difficult. 
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The city, state and federal governments have, in the past twenty-five years, 
invested substantial funds both into the Washington Park Urb^ Renewal Project as 
well as the surrounding area. However, the proliferating problems faced by the 
community have far outweighed these putilic efforts. Neighborhood 3 is now 
experiencing a new immigration of young black professionals who are acquiring many 
of the underutilized and abandoned buildings in the area. 'Their initiatives, unlike 
Those in the past, are complementing efforts on the part of existing residents, as well 
as renewing the interest of private investors in the area. However, the low incomes 
and limited job skills of many of the current resklents pose major handicaps to their full 
participation in Roxbury's revitalization' (Boston Redevelopment Authority, 1988). 

One data collector said, 'Getting to 'School 3' is harder than getting data about 
'School 3'.' Despite following the directions precisely, the visitor was sure he had 
gone wrong. The journey started with a drive down a si)>lane, major city artery, then 
took an abrupt left turn into a maze of narrow streets, checkered with inhat)ited and 
boarded-up buildings, interspersed vtnth vacant, trash-filled lots. The drive continued 
onto a short leg of a major city street, then right onto a four-lane divided highway that 
went two blocks and stopped. To the left of this strange, truncated boulevard (Martin 
Luther King Boulevard built in the 1960's), was a large abandoned field house and an 
overgrown park-reminders of promises not kept. School 3 sat on a hill on the far side 
of this park. 

A Verbid Snapshot 

The most prominent feature of the two-story red brick school was its large red 
chimney. Cars came and went in the small paricing lot. Two police cars stopped and 
the officers went into the building. A brown sedan blocked the entrance walk. A 
woman sat in the passenger seat, staring out vacarttly. On the entrance steps, a half- 
eaten sartdwich curied in the pale winter sun. The original entrarx;e to the school was 
changed to a side door, so that entering students would pass by the office on their way 
to class. By redesign, then, there was no foyer, no large space for any unmonitored 
gathering. The students were funnelled down into a long narrow hall, decorated by a 
brightly colored mural pi^'inted by the students. To the left of the front door was a large 
auditorium. Wooden chairs, attached in groups of five, form in'egular rows facing the 
stage. The day featured a 'reward movie,' Roger RaUx't. Students filed in to find 
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seats in the already darkened auditorium. The din became a roar as the sounds of 
the students' talking in even conversational tones bounce off the hard surfaces. 

To the right of the front door was the main office, the princip<' 's office, and the 
office of the Director of Instruction. Student activity boards annc jnced upcoming 
events and a poster entitled 'We are Family' identified the students and their 
homerooms. Through a door, a small sign said: 'Enjoy life, this is not a dress 
rehearsal". The first floor classrooms were devoted to the Tth/Sth graders', who were 
overage seventh graders and most eighth graders. The second floor housed the 
'6th/7th graders' who were all sixth graders and most of the seventh graders. The lab 
school, a school-within-a-schocl. was on the second floor, over the office, separated 
from the other students. The building, like the surrounding neighborhood, was 
rambling, with lots of ups and downs and dead ends. Staircases descended into 
blank walls. Halls funnelled into dead ends. Rooms sat off by themselves. 

School 3 was built in 1911. Its general physical condition in 1989 was very 
rundown. The impression was one of uneven attention. A teacher described 
maintenance as a 'patchwori<.' She said, 'Recently, asbestos was removed for the 
school. We had been tokj this had been taken care of years ago.' In one classroom, 
the blackboard and part of the plaster wall had fallen, exposing the lath behind. 
Another teacher said, 'The building is in terrible shape. The teachers' room is a 
disgrace. I want to know which room I am cioing to have next year so I can paint it 
myself.' School 3 was not unlike the streets '/aveled to get tiiere; a new window next 
to a shattered blackboard, mirroring the neighborhood of abandoned buildings next to 
occupied homes. Despair and hope, with degrees of each, lived side by side at 
School 3 and in its neighborhood. 

Resources 

Like Schools 1 and 2, School 3 was supplied by the central administration and, 
like the other schools, it had to be resourceful in getting additional school supplies, 
equipment, and building supplies from businesses and other agencies. School 3 
showed evidence of some repairs in progress. Huge windows were being replaced; 
the new ones were unmistakable with their rust protected metal frames, but here and 
there old ones with chipped yellow paint on cracked wooden fames seemed to have 
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been overlooked. They would all be replaced eventually, but through two different 
sources. Most v««re supplied by Massachusetts Port Authority. But the agency was 
responsible only for classrooms, because of the noise cre'"^ by airplanes going and 
coming at Logan Airport interfered with teaching . The other windows, for the offices 
and corridors, where no teaching took place, had to be supplied by the central 
administration. 



The Principals 

School 3 had three prindpals during the year and a half of data collection for 
the study. In fact the turnovers took place in the space of six months. 

Prindpal 1 

The first principal was a former Marine, who patrolled the halb all day, keeping 
order and picking up papers. He had not had a vacation in two years. He said: 
'School 3 has replaced home. It is a pleasanter place than home for many of the 
students.' The principal saw his leadership style as benevdentiy patriarchal and 
authoritarian. His patnarchal leadership style was reflected in his priorities for School 
3 which he based on his assessment of his students' needs; first - social, second - 
medical, and third - educational. 'School is taking over jobs formeriy done by the 
home, churches, social organizations, churches, and governmental agencies.' He 
saw Ns job as providing a safe atmosphere, counseling parents, supporting taachers. 
and being a 'father' tr dents. 

On Principal 1's leadership, one te cher reported, 'Discipline is selective, 
en-atic, and almost nonexistent. One student started a fire for whk:h the penalty is 
automatic suspension, but the principal ttiinks he is a good kid so he didn't punish 
hinr:' Another sakJ, 'Disrespect for the prindpal is almost total. There is no folloy^ 
tlvough and no back up for teachers, and the kids know H.' Another reported, 'I would 
like consistency from administi-ation in ta'eating the teachers and the kids. There is 
inconsistent punishment. A broken rule which may result in suspension with one 
student may not for another.' Another wanted 'a stricter principal who follows 
through.' Another said,'rm leaving! Until the principal aiKl administration changes in 
this school, I see very littie hopf> for tilings improving.' 
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Principal i was notified of his discharge approximately 10 days before the 
opening of school in Septerr'ber of 1988. 

Principal 2 

When Principal 2 became principal of School 3 in September, 1988, he wanted 
nothing to get in the way of his miss*on to tum around the beleaguered school. 
Describing the school as a 'hellhole,' Principal 2 set out to remove drug u^'^'^s fr^ 9 
nearby park, convert weary parents into education boosters, and . 
bureaucrats to pay for building repairs. But in a quick tum of events s^j; jis 
am'val. Principal 2 was defending himself against charges that he has bec^...« the 
obstacle to rebuikjing what is one of the city's most neglected schools. 

In his brief, four-month tenure, (Principal 2) has generated a 
controversy that has split the (School 3) faculty. Last night 
Superintendent Laval 5. Wilson held an emergency meeting with top 
administrators about the school.. (The Boston Globe, January 13,1989). 

Principal 2, a black man, had joined the Boston Public Schools in 1974 as a 
teacher and later became an administrator, serving as an assistant headmaster in one 
of the system's more highly regarded high schoois. His leadership style was 
authoritarian. 'I was appointed by Wilson as a get-tough administrator who would 
bring about refomns. Teachers who criticize me either do not want to put in a full day's 
v^ork or they remain loyal to my predecessor' (Principal as quoted by The Boston 

January 13, 1989). He was perceived by many of his staff as 'leading through 
intimidation and harassment, not cooperation and collegialityV 

An avid reader of the school effectiveness literature. Principal 2 arrived at 
School 3 a week before the start of school with his fully developed S*year plan to 
reform the school. A plan for change had already been initiated by Principal 1 in 
collaboration with the Director of Instruction and the staff. Ignoring the existing plan, 
Principal 2 started his new plan which featured aeating a caring environment, making 
some cosmetic physical changes ('these are symbolic'), creating an active parent 
council, and providing professional development for ttie staff. He wanted to bond - 
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bond teachers to students, bond parents to the school and, most importantly, bond 
teachers to him. 

'Most of the staff do not share my hopes and plans for (School 3) and are 
resisting change,' he said. Ironically, most of the features of his new plan were 
included in the existing plan. By January, he had created a hostile atmosphere, made 
few physical improvements, alienated many parents, and divided the staff. He was 
replaced by Principal 3 on January 27, 1989. 

Principal 3 

The new principal of School 3 was a black woman who had served most 
recently as an assistant principal at one of the most higNy regarded middle schools in 
the system under a p>rincipal wh'vn she regarded as her mentor, who was frequently 
cited for his school's outstanding achievements. Her immediate goals were to rebuild 
staff cc^esion, restore order, reassure parents, and focus on the educational needs of 
the students in School 3 for second half of the school year. She exhibited a straight- 
forward, open manner. Her decisions demonstrated a firm, yet cautious leadership 
style. She appeared to bB willing to share leadership responsibilities with other 
administration members and staff. Her actions demonstrated a more relaxed, yet 
conscientious and thorough, personal style. A teacher said, ' With the new principal, 
there is a new tone. She's more laid back. It's a lot more peaceful.' 

The Students 

Of the approximately 250 students in School 3, 210 provided usable returns to 
the questionnaire. Identifying themselves by race/ethnicity, 67.1% said they were 
black; 18.6% Hispanic; 6.2% white; 2.9% Asian, and 5.2% 'other.' Its enrollment two- 
thirds black. School 3 reflected the greatest racial imbalance of the four schools. 

Students reported their ages to range from 1 1 to 16 as follows: 8% were 1 1 
years old; 26% were 12 years old; 32% 13 years old; 20% 14 years old; 10% 15 years 
old, and 3% 16 years old. Like Schools 1 and 2, School 3 had a larger male 
population~56.6% male to 43.4% female. Like School 1 . the majority of the students. 
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Sd.4%. walked to school, suggesting that most of students who attend School 3 live in 
the neighborhood: 32.9% took the txis; 4.1% arrived by car. and 3.7% took The T.' 



About 30% of the student population changed during the year. BPS data 
showed the following figures for School 3: 14 new BPS admissions; 34 BPS transfers 
in; and 41 BPS transfers out. including 33 to other school systems. 0 drop outs.and 8 
unknown. 

Unlike Schools 1 and 2. School 3 did not have a bilingual program or advanced 
work classes. Students were assigned to the schools lab-school-within-a-school by 
Central Administration. Asked if they were assigned to any special programs, 33% of 
the students at School 3 said no. while 65.5% reported they had some form of special 
or remedial program. 

Like those in Schools 1 and 2 . when asked what do you like about teaching in 
this school, one teacher said. The kids. I live in the neighborhood and I'm involved 
with the kkis in and out of dass.' Unlike those in Schools 1 and 2, another teacher 
said. 'Kids roam the halls all day. Fighting is frequent and often ignored. Running in 
the halls is continuous.' When asked do you go out into the halls, he said. ' They don't 
bother me. I don't bother them.' 

Another teacher reported an increase of disturbed students in regular classes, 
citing a state reduction of quotas of students eligible for special eduration. (In fact thi^ 
was not a policy of the dty or the state.) She pointed out a student who had been shot 
in a local park the week before. She said that some students were walking arcund 
school with bags possibly vtnth concealed weapons, in violation of school njles. 

The Teachers 

'There is no cluster system, no department head, no team, no way to sha.e 
materials, planning time, or program.* a teacher reported. Unlike Schools 1 and 2 
which were just getting started with a duster system, the 28 teachers at School 3 were 
not yet organized in teams of any sort, and there was no common planning time. At 
this writing, a year after the majority of data collection took place, the teachers were 
being organized into two clusters. One joined teachers of sixth and most seventh 
grade dasses; the other induded teachers of overage seventh graders and all eighth 

49 



grade classes. Wit the arrival of Principal 3, the teachers began to enjoy common 
planning time. 

The teachers were assigned to clusters by the administration according to the 
type of teaching certification they possessed; teachers of sixth and seventh grades 
needed an elementary certification, and teachers of seventh and eighth grades 
needed a certification in the subjects taught. Of the 21 teachers (about 80%) 
responding, 81% reported teaching in School 3 from 1 to 5 years; 33% were first year 
teachers. The remainder had taught in School 3 from 5 to 26 years. 

A 10-year veteran teacher with four years at School 3 observed, 'I don't go up to 
the teachers' room. It's very bad with everyone sitting around talking about how bad 
everything is. The teacher morale is bad.' A first year teacher at School 3, with 5 
years experience, said, 'The teachers here are a good group. They're friendly and 
helpful with some exceptions.' She rarely interacted with other teachers. A special 
education teacher, she and her students had all classes and ate breakfast and >unch 
together in her room. Another said,' I would say tiiat 26 out of 28 teachers in this 
school are discontent. This year four teachers have applied for transfers, and three 
have quit. Teachers try hard to band together but are afraid. Even the ones who wori< 
for the principal (Principal 1 ) admit to being afraid of him. When it comes time to face 
him, they back down.' 

According to a news reporter who interviewed teachers in School 3: 

Staff morale at Scfiool 3 has been low for years. About half 
of its 30 teachers sought and received transfers to other schools last 
year The situation has not improved under (Prindpal 2), according to 
some administrators, teachers, and parents. They said Prindpal 2 has a 
hot temper and has intimidated staff. He has tried to lead through 
intimidation and harassment not cooperation and cdlegiality (Boston 
Glove. January 13, 1989). 

School 3 reported the racial-ethnic composition of its faculty as 68% White and 
32% Black. There were more female teachers than male teachers in School 3, as was 
true for Schools 2 and 4 and unlike School 1. Of the respondents, 39.1% reported 
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being male and 60.9% reported female. At School 3, 57.1% said they had advanced 
degrees. 

School Schedule and Activities 

The school day was divided into eight periodic; seven 45 minute periods plus 
homeroom, including 'USSR,* at the end of the day. The day started at 7:40 a.m. and 
ended at 1:40 p.m., following the same schedule as Schools 1 and 2. There was no 
flexibility in scheduling. The teachers complained loudly: "Administrators interrupt 
classes constantly. They take the well behaved girls out to run errands. Other 
teachers wander in. Administrators wander in. It is not related to observation but 
simply communicates the idea that nothing important is going on." Another said, "Kids 
frequently interrupt classes with messages sent from the administration. They don't 
think dass time is important." 

Afterschool programs included: remedial programs such as study skills and 
tutoring; clubs, student council, and the school newspaper; and sports, including 
basketball, track, and Softball. The physical education 'eacher said, "There is little 
attention given to the P.E. program at the school, with no standards for repairs, 
hygiene, etc. P.E. is 'pushed to the back' on agendas, and there is a need for at least 
one other part-time person to share the burden. The school needs a strong P.E./sports 
program, with the accompanying mascots, rallies, etc. to boost morale amongst both 
students and faculty. P.E. is the morale of the school." 



SCHOOL 4 



The Building and Its Neighborhood 



A school booklet pronounced School 4: "A building that has four walls, with 
tomorrow inside." School 4 was a large brick square, composed of a 3-story, 
rectangular main building, constructed drca 1890, joined to a similar sized, 2-story 
rectangular annex built behind the main building in 1939 by the Public Works 
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Administration of the U.S. government. The School sat solidly and stolidly on a point 
of larxl created by the intersection of a large city thoroughfare crossed diagonally by a 
narrow one-way street. The school lay in the shadow of a very large dty high school, a 
fortress*like facility of enormous proportions, further exaggerated by its site, 100 or 
more feet above the ground tovel of School 4. Another block away was a major city 
hospital surrounded by satellite medical facilities. School 4 resided in the same 
general residential neighborhood as School 2. 

A Verbal Snapshot 

The monotony of the brick facade of the main building was broken by simple, 
classic stone trim over the windows. The main entrance to the school was through one 
of three large, green, doutde doors which served the main building. The center door 
was unlocked. In the main foyer, the visitor noticed the walls at once. They were 
covered with student projects. Brightly colored, construcborvpaper maps arxj flags, a 
story in pictures, a large painted mural of 1890 skaters, ind a 'Health and Fitness* 
display all bespoke of hours of research, learning and labor. The works were hung at 
student eye level for easy viewing. Also, the painting treatment of the foyer walls-pale 
green aboye and bright yellow below-lowered the high ceiling and aeated a people* 
sized space. The worn wooden floors were dean despite the ankle-deep winter slush 
outside. 

A teacher seated at a desk outside the office asked the visitor to sign a visitors' 
book. Two green park benches faced each other in the middle of the foyer. Three 
boys sat talking in soft tones, waiting for the assistant principal. One boy looked up 
and said: Tm in trouble*. They are called in turn to in the office, and then disappear 
into the building. A group of students passed by talking in a friendly way. An inviting 
sense of order prevails. 

Opposite the front doors was the assembly hall. It was a large auditorium with 
permanent seats. On the stage were two large yellow backdrops painted with downs 
and t>alloons, suggesting a carnival or fair. Hallways on either skle of the assembly 
hall led to the first floor annex which housed one group of sixth grades. The main 
building's first fioor housed eighth grade dassrooms. Througt. one classroom door a 
teacher could be seen giving an animated sdence lesson. 
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Thd second floor of the main building was occupied by computer facilities, the 
library, and the office of the Director of Instruction. Some special education classes 
were held on this and the first floor. The second floor annex housed the second sixth 
grade duster. Seventh grade classrooms were assigned to the third floor. The school 
had no cafeteria facilities, but room in the basement had been made into a lunchroom; 
it is dean and well lit with windows to the ground level. Students returned to their 
dasses from lunch in relaxed single file. 

While School 4 was a very old, well*wom building, continually in need of 
repair, the atmosphere was alive, and the students arxj teachers seem energetic and 
fresh. As in the other three schools, maintenance was a low priority item with Central 
Administration and a chronic problem to School 4. The principal showed several 
broken windows which had been open to the elements during the fall and winter. One 
teacher said. Taint falling from the ceiling is not condudve to learning.' 

'I'd like the school to be a prettier place to come to. Students and teachers 
alike have put a great deal of time into enhandng the appearance of the school. The 
ceilings are peeling, the window shades arc torn or missing. Students have lots of 
artwori< put up in the halls. And teachers took time last year to paint the staircases/ 
said a seventh grade teacher, with 1 1 years experience at School 4. 

Resources 

its publidty brochure prodaimed: 'School 4, through the energy of (Principal 1 ). 
has developed an 'unoffidal' theme of 'technology' because it has 140 computers, the 
largest number housed by any public school in Boston.' Like their counterparts in the 
other 3 schools, the two prindpals who served School 4 during the course of the study 
were alert to sources of supplies aixJ equipment both in the public and private sectors. 
Principal 1 was successful in getting enough computers to make his school as 
specially designated site for studying microcomputers in education. (See the 
description of Principal 1 below). But some teachers felt that emphasis on computer 
was overdone. Regarding other learning resources, one teacher reported, "Supplies 
are always available, and Xerox is never used up.' Only a few complained of 
limitations on texttxx)ks. Those who did said there weren't enough to go around, so 
they couldn't be used for homewori^. 
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The Principals 

There were two principals at School 4 during the 1 and one-half of data collection for 
the study. 

Principal 1 

The "Computer" Principal became principal at School 4 in 1978. He said he 
decided to bring computers to the school in 1980 as a way to draw resources into the 
school. "I look at technology as an investment,' he said. 'I came to the conclusion 
that in order to get donations from companies we had to denrK)nstrate that we are the 
technological leaders in the system.' In 1981, anmed with $30,000 in School 
Departrr;ent funds. Principal 1 h&w. two small computer labs built. Since then, he has 
convinced several computer companies to donate machines. And, in 1983, according 
to the School Booklet, IBM designated School 4 as its model computer school In the 
state." 

The first principal was a strong leader, whose focus was education and student 
achievement. An Asian, with 17 years in the Boston Public Schools and principal at 
School 4 for 8 years, he assumed leadership after a succession of 4 principals in 4 
years. His abrupt, no frills style was illustrated in his opening speech each September 
to incoming teachers. It consisted of 3 commands; "One, you have to like the kids. If 
not, you don't belong here. Two, you have to know your subject. If not, you don't 
t}elong here. Three, you have to begin teaching 5 minutes before the kids come into 
your room." In another example of his style, he said to his litxarian who asked for his 
advice, "I hired you &3 a litxarian. Now be a litxarian." 

Like the first principal at School 3, this principal "is always in the halls", but this 
principal seemed to be doing more than looking for waste paper. "He is everywhere. 
He comes early and stays late. He is accessible. He tells you what he expects and 
treats students and teachers fairiy and consistently," said one teacher. His reported 
fair and consistent manner also differed from the perception of School 3's principal 
who was seen as having favorites among students and teachers. 

Some teachers saw his leadership style as autocratic and inflexible. "The 
principal sometimes has tunnel vision about new ideas. If you have a new idea you 
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have to be persistent. Some teachers give up/ 'He is decisive and firm and can be 
intractable.' On the other hand, a teacher reported. 'He's always willing to listen to 
you. If your idea is better that his, he'll change ' 

The principal was pictured by several teachers as a very task-onented leader. 
Teachers are here to educate. He is interested in teachers only as related to their job 
performance, not socially.' He exhibited few (iroup maintenance skills suggesting 
either staff maintenance is a low priority, or he lacked these skills. Any social activities 
were initiated and performed by staff, yet he controlled the composition of the groups 
by virtue of his selection of the unit (duster) members. 

'He can seem intimidating. I was at first.' said a teacher of four years at School 
4. 'When he interviewed me. he took a knife out of his drawer and said he'd taken it off 
a kid that day.' said another teacher indicating she thought it was a dramatic ploy to 
test her at)ility to woric with inner dty students. She thought he intimidated teachers in 
order to weed them out eariy. "If they can't stand his pressure, then they won't be able 
to stand the pressure fi^om the kids.' she said. 

Another teacher said. 'He gives real supervision. The first week he was in my 
class eight times, but he never interrupts. He gets rid of incompetents. He notices 
everything; how you talk to the kids in the hall, for example.' You may not like all (the 
principai'3) decisions but he is a creative genius, and fosters creativity in others. He 
runs the place well. ' 

Prindpa! 1 had dedded to move on at the end of the 1988 school year. He 
became Superintendent of High Schools for Boston Public Schools. 

Prindpal 2 

Unlike the transition of principals in School 3. the change of leadership at 
School 4 was expected and orderiy. Prindpal 1 had dedded to leave, and Principal 2, 
chosen in a timely manner, was expected by the students and staff in the Fall of 1988. 
An Hispanic man. Prindpal 2 had served in the Boston Public School system for 10 
years in varying teaching and administrative capacities. His manner and leadership 
style were more personable and less intense than that of his predecessor. His plans 
for changes from Prindpal 1 included: (1) using the computer as a remedial tool as 
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well as a tool for applications, and (2) initiating the return of arts and physical 
education programs. 

Students 

Of the approximately 400 students enrolled at School 4 in 1989, 317 responded 
to the student questionnaire. The desaibed their race/ethnidty as follows: 26.8% 
Asians; 36% black; 12.6% white; 18.6% Hispanic; and 6% 'other.' Students reported 
their ages as follows: 10% said 11 years old; 27% said 12; 29% said 13; 23% said 
14; 8% said 15; 1% said 16; and less than 1% said 18. This represented a similar age 
range reported by the other schools. Unlike the other three schools. School 4 has a 
larger female population, 52% female to 48% male. 

Like School 2 , the largest percentage of students (43.5%) at School 4 
reported that they come by school bus; 22.2% sakJ they come by 'The T;' 24. 1% said 
they walked to school, and 9.9% said they anive by car. 

School 4 had a larger turnover rate, at 35%, than the other schools. Changes 
in school population during the year were reported as follows: new BPS admissions - 
28; BPS transfers in - 64; and BPS transfers out - 66. Student losses included 72 to 
other school systems, 9 dropouts, and 14 unknown. 

Students were assigned to special education p)rograms in School 4 by Central 
Administration, as was the case for the other 3 schools. There were no bilingual 
programs at School 4 and no advarx;ed work classes, orJy regular and special 
education. Almost two-thirds (66.5%) of the students in SchocI 4 reported that they 
were enroled in some form of special or remedial program, including Chapter I 
programs, and 30% reported that they attended only regular progranns. 

When asked about the students, a sixth grade teacher of 17 years experience 
said, 'The kids are racially diverse; Asian, black, Hispanic, project kids from 
(Neighborhood 2). You either love or hate this age group. I love it.' The librarian said: 
'We have the same student population as other schools. School 4 students come from 
the worst projects in Boston and yet look at them.' S^:e waved her hand to show off 
the clearly engaged students working. She thought s'^e knew all the students at 
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School 4. 'If you lined them up outside the building, I might not be able to identify 
them all by name, but I know them. That was what was so upsetting about ha;ing my 
wallet stolen by one of 'my students'. I'll have to be more careful.' 

The students are the reason why I'm here. I tell my students, "You don't work 
for me. I work for you.' This school is known for achieving. But their are some kids 
here who are not achievers in the same way. They need to t>e given other options. 
The goal in my dass is to in^re. For example, we do a lot O' writing in this dass. But 
some students are put off from writing. My first job is to get them interested; so 
sometimes, instead of putting a pendl and a notebook in front of a student, I put a 
video camera in his hand. He suddenly begins to see the world differently. The 
subject is no longer dull. But you don't stop there. That* s only the first step,* said a 
teacher of 1 1 years' experience at School 4 and the only black male teacher. 

"The students here are wonderful to work with. I think the students' attitude and 
sense of pride have a lot to do with what (Principal 1 ) has done with this school. Here 
the teachers are expected to teach, and the students are e^qpected to learn. This is 
their job,' said a reading teacher. 



The Teachers 

There are good teachers here. Prindpal 1 has done a great job at attracting 
good teachers,' said a 20-year veteran teacher, completing her first year teacher at 
School 4. The 45 teachers at School 4 were organized in units (now called dusters); 
membership was determined by the principal. At this writing, the teachers we^e 
organized in five dusters: 1) sixth grade elementary team teaching approach; 2) 
sixth grade middle school team teaching approach; 3) seventh grade duster; 4) 
eighth grade cluster, and 5) bilingual cluster (although there was no officially 
designated bilingual program at School 4 during 1989). One teacher said. There is 
integrity in each duster. Teacher input is great. Not all teachers in the duster are alike, 
but the contrasting styles and values are good. It is like a mini school within the 
schod. Students stay together so they move in a cluster. Also, you get kids you 
worked with the previous year. It helps espedally at the t>eginning of the year when 
you have to spend so much time getting to know the kids. You already know their 
strengths and what they need to wort< on. They know you and your expedations." 
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'There are weekly cluster meeting. It means both the administration has tight 
control and there is individual attention paid to the students. There are froquent 
discussions of students, so they don't get lost,' he added. Unit members had the same 
free period. One computer teacher said, 'I work mostly with my unit but I have initiated 
ways I can work with other teachers in the use of the computer. For example, with the 
English teachers and their projects-the work processor; with the Social Studies 
teachers and their projects-the graphics functions.' 

'The cluster system works for the most part, but it can also be very isolating. As 
a computer teacher, I don't necessarily get to work with other corrputer teachers. I 
have to seek out other computer teachers on my own time.' 'There must be a way to 
make the cluster system more flexible,' said another. Teachers were assigned to 
classrooms by grade, teaching style, and language. 

Of the teachers in School 4, 58% responded to our questionnaire; 30.6% 
reported they had been teaching at School 4 for five years or less; this was a 
significantly lower percentage than at the other 3 schools, reporting 58%, 64% and 
81% respectively. Among the rest, 19.1% reported teaching 6-10 years; 15.3%, 11-15 
years, and 19% more than 15 years. The racial/ethnic composition of School 4 was: 
71% White, 13% Black, 13% Hispank: and 3% Asian. The teachers responding were 
42.3% male and 57.7% female. At School 4, 68.9% reported holding advanced 
degrees. 

School Schedule and Activities 

The regular school day was divided into 8 periods; 7 periods plus a 10-minute 
'USSR.' A 6-minute homeroom period started the day. Flexibility in scheduling was 
accommodated within dusters for testing, projects, fieldtrips, etc. Schoc! began at 
8:32, unlike Vne other schools which commenced at 7:40. School ended at 2:30 un'ike 
Vne ottier schools which ended at 1:40, but all four schools had 6-hour days. 'Students 
are dismissed after the arrival of at least four full-sized buses. Homeroom teachers will 
accompany their students all the way to the side doors for dismissal,' read a bell 
schedule notice. 
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Summary and Discussion 



The sample sites for the research were four middle schools located in one 
district of the Boston Public Schools which had been paired officially with Boston 
University for 15 years, as part of a court ordered desegregation plan. While the 
neighborhoods were diverse, the students who attended the schools were more 
homogeneous economically, if not ethnically and racially, than their neighborhoods. 
This was the case because oftentimes families with financial discretion did not send 
their children to the public schools. The pattern was especially true for parents of 
females, who , if they had marginal financial discretion, would choose to send their 
sons, but not their daughters, to these schools. One of the first and most startling 
findings atxjut the four schools in the sample was the overall sex ratio: almost 55% to 
45%, males to females. 

The one relatively more affluent neighborhood which was the setting for 
Schools 2 and 4 in the sample included a preponderance o< childless households, 
including elderly people and young professionals. College and graduate students 
and unrelated people living together to share expenses were attracted to these 
neighborhoods, and inflate the median household income. Middle school students 
were bussed to Schools 2 and 4 in larger numbers than to the other two schools, 
which drew more heavily form their own neighborhoods. The neighborhood for 
School 3 would be considered the most disadvantaged. 

Figures reported in City of Boston's Neighborhood Profiles (1983) show the 
following differences based on 1984 data: 



Neighborhood Median Household Unemployment Percent in 

Income R^tc Poverty 

School 1 $16,950 11% 31% 

Schools2&4 $22,400 3% 17% 

School 3 $13,000 14% 31% 

Citywide $19,250 6% 21% 
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The administration of student questionnaire, in tiie four schools was extremely 
successful in achieving a return rate which was equal to the attendance rate, or at)out 
85% of the schools' enrollments, thanks in large measure to the high degree of 
cooperation offered by the teachers and administrators in the schools. Student data 
reported in the study was corroborated by data available from the Boston Public 
Schools. The figures on students presented here are those taken from self reports. 

Most of the students in the sample schools were minority group members. Of 
the major ethnic groups. Schools 2 and 4 presented a more balanced student 
population, while School 1 with its Hispanic k>ilingual program had a majority of 
Hispank^s, while School 3 in a predominantly black neightx>rfx)od had an enrollment 
which was more than two-thirds black. Their racial/ethnic distributions were as follows: 



Race/Fthnidty 


Asian 


Black 


White 


Hisoanic 


Other 


School 1 


2.4% 


30 3% 


7.2% 


55.8% 


4.3% 


School 2 


24.4% 


25.7% 


10.8% 


33.2% 


5.8% 


School 3 


2.9% 


67.1% 


6.2% 


1c 6% 


5.2% 


School 4 


26.8% 


36.0% 


12.6% 


18.6% 


6.0% 



The vast majority of students at the four schools reported their ages to be 
between 12 and 14, in March of their school year. Only 12% were younger than 12 
years of ago, and 10.5% were older than 14. School 4 was significantly different from 
the other three schools in enrolling a majority of girls. The sex ratios taken from 
student questionnaires in the f«xjr schools were as follows: 



Sex Ratio 



Female 



School 1 
School 2 
School 3 
School 4 



53.1% 
59.2% 
56.6% 
48.0% 



46.9% 
40.8% 
43.3% 
52.0% 
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Building, Size, and Scheduling 

All of the school buildings were old, consequently needii ig constant and costly 
maintenance. School 3 and a part of School 4, having t>een txjilt at the turn of the 
twentieth century, were thirty years older than the other schools. The others, Schools 
1 and 2, and the annex to School 4, were built in the 1930's. School 1 housed the 
largest student population; almost two and a half times that of School 3, and 1.67 
times the size of Schools 2 and 4. 

Scheduling at School 1 differed from jiat of the other three schools. School 1 
had 5 periods plus homeroom and a silent reading period. The additional time 
needed for each period at School 1 may have been necessary simply for its very large 
student body to move from class to dass. The other three schools had six periods 
plus homeroom and silent reading periods. They scheduled 45-minute classes, 
creating an additional period from the saved minutes. 

Scheduling at School 4 was very precise. A teacher said, 'Classes start five 
minutes before the offidai time. The filing rule means all stijdents and all teachers are 
in comdors as students file in single file along corridors to the next dass. Clocks, 
watches, etc. are synchronized.' 

Prindpals 

During the past 10 years. Schools 1 and 4 had experienced the sustained 
leadership of one prindpal for 10 and 8 years respectively. The principal of School 4 
had resigned that position to assume an assistant superintendency. His successor 
was assigned in a smooth, orderiy fashion. School 2's prindpal was entering his 
ttiird year in office there during the year of most data collection for the study; he was 
transfen^ed in the final year of the study, and replaced by another man. But School 3 
had had a succession of three principals in ttie year and a half of data collection. 
Among all of the priridpals, the six men induded one Asian, one white, two Hispanics 
and two blacks. Both women were black. All were very highly educated, with many 
credits beyond a master's degree but not a doctorate. All were experienced educators 
with at least some formal, supen/ised braining in administration and leadership. 
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Teachers 



Percentages of teachers resporxling were: in Schaol 1, 48%; School 2, 33% 
(and an additional 19% who responded to an earlier version of questionnaire); School 
3, 80%; and School 4, 58%. The teachers in the four schools were not significantly 
different from each other on a number of demographic characteristics. Their 
male/female ratio was 40.2% to 59.8%. Their racial/ethnic distribution was as follows: 
Asian, 1.2%; black, 16.5%; Caucasian, 63.5%; Hispanic, 10.6%; and other, 5.9%; the 
balance, 2.3% would not say. The teachers constituted a highly education work force. 
All of them had a least a bachelor's degree; 27% reported having some graduate 
v^rk; 19% had a master's degree and 43% had credits beyond a masters degree 

The teachers represented a wealth of teaching experience. Only 15.4% had 
between 1 and 5 years of experience; 20% had 6 to 10 years; 15.4% had 11 to 15 
years: 27.5% had 16 to 20 years; 11% had 21-25 years, and 1 1% had more than 25 
years. The fact that the teachers did not differ significantly among schools in any of 
these demographic characteristics was not surp[..:»ng, because there is a great deal of 
transferring among teachers from one school to another within the system. Only 
School 4 differed significantly in this respect. It had tha highest percentage of 
teachers at the school for more than 5 years, 70%. Vr e percentage of teacher who 
had been at School 1 more than 5 years was 32%, School 2, 36%, and School 3, only 
19%. 
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CHAPTER 4 



SCHOOL DIFFERENCES IN STUDENT ACHIEVEMENT 

The ability to differentiate among schools on the basis of student achievement is 
central to the logic of this study. If the schools did not differ with respect to important 
achievement outcomes, there would be no point-irxjeed it would not be possible-to 
study what practices and conditions in the school environment are associated with 
these outcomes. However, while it is essential to establish that the schools are 
different, it is also crucial to use appropriate and valid inriicstors of the differences. 

A point of departure for this research has been that standardized tests of basic 
skills are too narrow a measure of school effectiveness. What they do measure, they 
measure efficiently, with a high degree of reliability. The problem rests more with 
what they don't measure-higher order thinking, complex problem solving, and 
creative endeavors, as well as prosocial behaviors and volunteer service. 
Recognizing this limitation, the present study examined standardized test scores as 
measures of basic skills but also sought to complement these with additional 
measures of student achievement, including a new measure of higher order thinking 
and indicators of prosocial behavior. School differences on traditional measures of 
student achievement are the focus of this chapter. School differences on the new 
measure of higher order thinking are also given here, but a fuller discussion of the 
psychometric qualities of the new measure, called TOPS, or Test of Problem Solving, 
is reserved for Chapter 5. 

Traditional Measures of Student Achievement 

The original plan for the research called for the use of available standardized 
tests of basic skills as well as available criterion referenced tests. The latter were said 
to be a better fit to the schools' cunicula, and therefore a more valid assessment of 
what the schools were actually striving to accomplish with their students academically. 
A writing sample with holistic scoring was to be used as a measure of aeative written 
expression. A new measure of higher order thinking in the context of scientific 
problem solving was also developed and administered as planned. All but the last 
measure were supposed to have been part of the Boston Public School System's own 
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plans for data collection. We would not Intrude further on this schedule, except with 
the new measure, which would not duplicate any of their efforts. 

Metropolitan Achievement Test 

The Boston Public School System, like a great many systems across the 
country, continues to rely on standardized tests to monitor the progress of its schools. 
For Boston, the choice is the Metropolitan Achievement Test, sixth edition (Prescott, 
Balow, Hogan & Farr, 1988). According to its developers, the MAT6 was designed to 
reflect basic curricular content taught nationwide. Individual subtests were developed 
according to blueprints said to reflect the scope, emphasis, and grade placement of 
objectives revealed by curriculum guides, state syllabi, textt>ooks, and professional 
references. The extent to which the MAT6 is valid for Boston depends on its fit to 
local objectives. The MAT subtests in reading anr' mathematics are administered 
each year in all Boston Public Schools during the second week of May. 

Criterion Referenced Tests 

In the three years prior to data collection for this study, the Boston Public 
Schools used their own criterion referenced tests which had been designed by groups 
of teachers to reflect the dty-wide curricula in several sut)ject areas: mathematics, 
science, social studies, and English. In addition, a writing sample was given, and 
teachers were trained to use a holistic scoring procedure to score their own students' 
papers. All of these were to be used in the present study of school effectiveness as 
measures of student outcomes which were more directly related to what the schools 
were seeking to attain than the MAT, a standardized test of basic skills. However, in 
the year of data collection for the study, only the CRT-Mathematics was retained with 
the perennial MAT for student assessment systenrv-wide. 



Testing Schedules 

The calendar of events in the Boston Public Schools which is circulated among 
the schools shows squares coded in dari< gray for the days assigned to system-wide 
testing during the months of May and June. The calendar for 1989 suggested the 
schools did little else during the last six weeks of school. In fact, these were days 
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when testing may occur, in May for the MAT subtests in reading and mathematics, in 
June for the CRT-Math and for final examinations given by individual teachers. The 
sbjdents were not tested all day, every day, on the dates designated for testing. But 
most knowledgeable observers would agree that tiie perception prevailed among 
teachers and students in the schools that they were being tested to death. 

Teachers objected strenuously to the imposition of additional tests. They 
argued that the CRTs, which had been developed three years earlier, did not reflect 
what was actually being taught in the schools, and therefore were no longer valid. As 
well they might, they did not raise the same argument against the validity of the MATs, 
and so the latter were retained. (The system's superintendent insisted on retention of 
the MAT despite advice to the contrary from his own staff and from outside experts.) 
No efforts were made to update or replace the CRTs. The same ones developed in 
1985 had been used in 1986 and 1987. The BPS Bureau of Research, with a 
professional staff of two, was in no position to engage in new test construction in 
addition to its other substantial responsibilities. Of the CRTs, only the CRT in 
mathematics was retained for system-wide assessment in 1989. 

Final Grades 

In tiie wake of these decisions to discontinue use of most of the CRTs, it 
became all the more important to obtain alternative indicators which would provide 
other dimensions of students' performance than scores on standardized tests of basic 
skills. The only choices available were final grades assigned by teachers in June, 
1989 in the following subject areas: reading, English, mathematics, science and 
social studies. 

Grades have limitations for comparisons beyond a single classroom, because 
teachers use a variety of methods for assessing, evaluating, and grading students. 
The methods might include daily assignments, responses to oral questions during 
instruction, paper and pencil tests and quizzes, performance appraisals, and 
homework. What student characteristics contribute to the assessment might include 
achievement, ability, effort, attitijde, interest, and personality. Even ttiose teachers of 
the same sut)ject who agree that achievement should be the sole basis for evaluation 
might disagree on what to measure. The way contiibuting data are combined to yield 
a composite index, and what cutoffs are used for assigning letter grades can vary as 
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well. Because grades are so idiosyncratic, grade to grade or school to school 
comparisons are virtually meaningless Indicators of school differences. Instead, final 
grades were used only in the present study in correlational analyses to study the 
patterns of relationships among grades and arTx>ng test scores. 

Analysis of Achievement Data 

Several kinds of analyses are reported for the achievement test data. First, 
descriptive statistics and graphic representations of the differences by school and by 
grade are shown for each test. Next, results of two-way analyses of variance-by 
school and by gradr-are summarized. Sex differencGi» in achievement data were 
studied, but these results are not presented here because in no case were significant 
differences found between male arxi female students on any of the test measures. 

Race was not used as a factor in these analyses because race correlated 
significantly with assignment to special program. A chi square testing the relationship 
between race and special programs produced a highly significant result at p < .0001. 
Asians were overrepresented in the advanced work classes, blacks in special 
education, Hispanics in bilingual education, and whites in the regular program. Since 
assignment to programs was made largely on the basis of test scores, analysis by race 
would have stacked the deck against those schools serving higher percentages of 
blacks and Hispanics. Instead, a fairer comparison was made within special program, 
by school. The factor of enrollment in special program could not t>e added as a third 
independent variable to create a three-way analysis, because only selected schools 
have a'' programs and many empty cells would result. 

Differences by School and by Grade 

Descriptive statistics for each school at each grade level are presented in 
Tables 4.1 ttirough 4.4 on the MAT-Reading, MaT Mathematics, CRT-Mathematics and 
the Test of Problem Solving respectively. Figures 4.1 through 4.4 present the mean 
scores graphically for data from the tables with corresponding numbers. 

Table 4.5 summarizes results of the two-way analyses of variance on each of 
the four achievement measures. For all measures, school differences were highly 
significant, as were grade differences, in all but one analysis. The notable exception 
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occurred in the analysis of MAT-Reading test scores. These did not change 
significantly over grade level. But it is also important to note that interaction effects 
were significant in all four analyses. Achievement differences among schools need to 
be qualified by grade level, so one-way analyses of variance were run to investigate 
school differences at each grade level, and Duncan Multiple Range tests were used to 
determine more specifically which means were significantly different from each other. 
These results are summarized at the bottom cf Tables 4. 1 through 4.4. 

MAT-Reading Scores 

As reported in Table 4.1, the four sample schools had MAT-Reading scores 
which did not compare favorably with the national nomns, as reported in the MAT-6 
Technical Manual (Prescott, BtaL, 1988). However, the ethnic distribution for students 
in the spring standardization program was very dissimilar to the racial/ethnic 
composition of the sample schools. The MAT standardization group was 75% white, 
15% black, and 7.9% with 'Spanish Surname,' (Manual, p. 6) whereas only 9.1% of 
the students in the present study were white. Asian, k>lack, and Hispanic minority 
students constituted the majority of the enrollments in the sample schools. 

While the norm group may be judged an inappropriate comparison for the 
sample schools, the fact that the students attending these schools at the higher grade 
levels fell increasingly behind on MAT-Reading scores is cause for concern. The 
average for sixth grade students, buoyed by the high scores for those in School 2. 
was only seven scaled score points below the mean on the national nomn (less than 
one/eighth a standard deviation). However, the average for seventh-graders enrolled 
in the four schools fell 25 points or almost two-thirds of a standard deviation below the 
mean for the nomn group. Eighth-graders in the sample averaged even lower, falling 
.72 standard deviations behind. 

Thus, the means for all four schools overall showed no increase in reading 
scores over grade level and comparatively fell further and further behind the national 
nomn for the grade level: but these overall results obscured different patterns for 
different schools. School 1 showed virtually no difference over grade level, and 
School 3 showed a slightly higher scores fc"^ its seventh graders compa. 3d to its sixth- 
grade students. The pattern for School 2 went from a high, exceeding the national 
average for its sixth grade students, to a precipitous drop of almost one full standard 
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TABLE 4.1 



Mean Scaled Scores, Standard Deviations, and Grade Equivalents on the 
MAT-Reading and Significant Differences Among Schools by Grade 



Grade Level 


Grade 6 


Grade 7 


Grade 8 


MAT Teat Form 


InLL 




* Adv. L 


Adv. 


M 


Type of Score 


ss 


GE 


SS 


GB 


SS 


GE 


National Nomis 


649 


6 7 


666 


7.8 


679 


8.8 




All Four Schools 


642 


6.0 


641 


6.0 


640 


O.J 




151) 


n-492 


(38) 


n-404 


(46) 


n-383 
— 


School 1 


636 


5.8 






633 


5.6 




150) 


n-213 


(40) 


n-175 


(43) 


n-169 


School 2 


662 


7.5 


636 


5.8 


657 


71 




(58) 


n-115 


(32) 


n-70 


(44) 


n-58 


School 3 


636 


5.8 


646 


6.3 


644 


6.1 




131) 


n-56 


(31) 


n-65 


(33) 


n-48 


School 4 


638 


5.8 


650 


6.7 


661 


7.3 




(46) 


n-108 


(38) 


n-94 


(52) 


n-108 


F Ratios 


8.00" 




4.02" 




9.79 




Duncan Tests 


1.3.4<2 


1,2<4 




1,3<2,4 



"p<.01 
""p<.0001 

Note.-Scaled score means are given in regular type face, standard deviations 
in parentheses, grade equivalents for Spring test admiiistrations in italics, and 
cell n's as noted. 
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TABLE 4.2 

Mean Scaled Scores. Standard Devia^ons, and Grade Equivalents on the 
MAT-Mathematlcs and Significant Differences Among Schools by Grade 



Grade Level 


Grade 6 


Grade 7 


Grade 8 


MAT Test Form 


Int 


L 


Adv 


L 


Adv.M 


Type of Score 


SS 


GE 


SS 


GB 


d d 




National Norms 


639 


6.7 


650 


7.5 


665 


8.8 


All Four Schools 




7 9 




6 9 


655 


8.0 




(44) 


n-485 


(32) 


n-407 


(38) 


n-373 


School 1 


646 


7.2 


641 


6.8 


639 


6.7 




143) 


n-213 


(32) 


n-179 


(28) 


n-162 


School 2 


658 


8.2 


638 


6.5 


669 


9.4 




(46) 


R" 1 14 


(27) 


n-69 


(38) 


n-58 


School 3 


625 


5.7 


627 


5.9 


658 


8.2 




(26) 


n-55 


(22) 


n-66 


(36) 


n-47 


School 4 


651 


7.6 


656 


8.1 


670 


9.5 




(47) 


n-103 


(37) 


n-93 


(42) 


n-106 


F Ratio 


7.45" 


** 


11.59"" 


21.34 




Duncan Test 


3.K4, 


2 


3<2.1<4 


K3.2, 


4 



""p<.0001 

Note.-Scaled score means are given in regular type face, standard 
deviations in parentheses, and grade equivalents for Spring test administrations in 
italics. 
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TABLE 4.3 



Means and Standard Deviations on the Criterion Referenced Test in Mathematics 
and Significant Differences Within Grade by School 



Gradfi LavaI 


SUV w 


Grada 7 


Gradtt 8 


All Four Schools 


58.8 


54.1 


60.5 




(22.0) 


(17.5) 


(20.2) 




n-428 


n-387 


n-330 


School 1 


54.0 


50.9 


47.2 




(20.3) 


(16.4) 


(15.8) 




n-155 


n-162 


n-136 


School 2 


61.1 


51.1 


64.4 




(23.1) 


(16.5) 


(18.7) 




n-132 


n-89 


n-80 


School 3 


63.2 


57.9 


79.0 




(23.8) 


(17.6) 


(11.9) 




n-51 


n-54 


n-31 


School 4 


61.2 


61.3 


71.8 




(20.8) 


(18.4) 


(14.7) 




n-90 


n-82 


n-83 


F Ratios 


4.07" 


8.56"" 


57.99"" 


Duncan Tests of 


1<^.4,3 


1.2<3.4 


1<2<4<3 


Mean Differencf.s" 









"p<.01 
""p<.0001 

Note. -Mean r>cores are given first in each cell followed by standard deviations 
in parentheses and call n's. 



■Schools are identifiec' by numt)er , consistent with usage in the text. A '<* 
indicates a significant difference among means in the order given. 
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CRT- Math 




■ School 1 
□ School 2 
^ School 3 
<0 School 4 



Grade 6 Grad«7 QradoS 

Rgure 4.3.A Une Graph o» CRT-Mathematics Scores by School and Grade 




■ SchooH 

■ School2 

■ schools 
□ School 4 



Grad«6 GMrad«7 QradeS 

Figure 4.3.B Bar Graph ot CRT-Mathematics Scores t)y School and Grade 
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TABLE 4.4 

M«an Raw Scores, Mean Percentage Scores , and Standard Deviations on the 
Test of Problem Solving and Significant Differences WitNn Grade by School 



Grade Level 


Grade 6 


Grade 7 


Grade 8 


All Four Schools 


16.9 [55%f 
I6.4)b 


18.1 [58%] 

(5.4) 


18.4 [59%1 

(5.7) 
n* 302 


School 1 


15.3 [49%] 

16.7) 

n-206 


16.8 [54%] 

(5.6) 

n-15o 


17.0 [55%] 

(5.5) 

n-132 


School 29 


20.7 [67%] 

(5.5) 

n-68 


15.0 [48%] 

(6.2) 

n-16 


17.1 [55%1 

(6.1) 

n-43 


School 3c 


14.7 [47%] 

(3.8) 

n-26 


20.6 [66%] 
0.9) 
n-27 


17.4 [56%] 
(5.7) 
n-42 


School 4 


18.4 (59%1 
15.4) 
n-91 


20.5 [b6%] 
(3 9) 
n-78 


21.6 [70%] 
(4.6) 
n"86 


Significant differences 


School 1<4 


School 1<4 


Schoo!1<4 



'Percentage scoi <(S, given in brackets, are raw scores divided by 31 , the total 
numt>er of items the test. 



''Standard deviations are given in parentheses. 

^The return rates for Schools 2 and 3 were too low to be considered 
representative. The tests of significance were recomputed, comparing only 
Schools 1 and 4 by grade. Highly significant differences favored School 4 over 
School 1 at all three grade levels. 
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■ School 1 
□ School 4 



Qrade6 Qrader QradeS 

Figure 4.B Bar Graph of Test of Problem Solving Scores by School and Grade 
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deviation to a point below the national norm for its seventh grade students, to a level 
only one-half a standard deviation below the national norm for its eighth grade 
students. Only School 4 showed steady and significant increases over grade level; 
still its perfomiance lagged behind national nomis. 

The fact that MAT reading scores showed a precipitous drop between sixth and 
seventh grade can probably be explained by the exodus of so many sixth grade 
students from School 2 to the prestigious "examination schools,' Boston Latin School 
and Boston Latin Academy which begin at seventh grade. School 2 houses 



TABLE 4.5 

Summary of Significant F Ratios from Two-Way Analyses of Variance 
Of Student Adiievemen^ Measures 



ANOVA Effect 


School 


Grade 


Interaction 


df 


3* 


2 


6 


Achievement Measure: 








MAT- Reading 


12.55"" 


NS 


4.88"" 


MAT-Mathematics 


21.75"" 


10.51"" 


7.63"" 


CRT-Mathematics 


37.95"" 


11.12"" 


9.04"" 


Test of Problam Solving* 


71.98"" 


11.01" 


NS 



"p < .01 
"p < .0001 



*Sinca representative returns on the Test of Problem Solving were obtained only for students In 
School 1 and 4, Schools 2 and 3 were eliminated from this analysis. The df for the school effect in the 
ANOVA with TOPS was 1; the df for the interaction effect was ^ 
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'advanced work classes", only at the sixth grade level, which appear to sen^e as an 

unofficial preparatory program for students moving on in the seventh grade to the 

exam schools. The drop in scores rejects a dramatic change in the population of 

seventh grade students at School 2; it is not an indictment of the school's seventh 

grade reading teachers. What is happening at School 2 to account for the dramatic 
rise in reading scores from grade seven to grade eight is less clear; it may be 
outstanding instruction, more likely it is attrition of lower achieving students. The 
same pattern of differences in means, high-low-high, for grades six, seven and eight, 
at School 2 is observed in the graphs for both tests of mathematics. 

MAT-Mathematics Scores 

MAT-Mathematics Scores for the four sample schools compared more favorably 
to national nomris t!ian the MAT-Reading Scores for these schools. As indicated in 
Table 4.2, the overall average for sixth graders even exce<KJed the mean for the norm 
group by eight scaled score points, or about .2 standard deviations. The means for 
seventh and eighth graders fell behind, by 8 and 10 points respectively, or about one- 
quarter standard deviation in each case. However, this overall finding varied 
significantly by school. 

Starting with sixth graders who averaged above the national norm. School 1 
saw its seventh graders fall slightly behind, and its eighth graders average 16 points, 
or more than half a standard deviation behind. School 2 had the same high-low-high 
pattern which it exhibited for the MAT-Reading scores. Sixth and seventh grade 
students in School 3 scored disappoinLngly low, but then the eighth-graders in School 
3 showed substantially higher performance than those in the lower grades, just .2 
standard devia'dons below the national norm. For better or worse, knowledgeable 
observers in Schoo! 3 think the relatively higher performance of its eighth graders is 
attributable to its eighth-grade mathematics teachers* "teaching to the test." Once 
again. School 4 was the only one of the four schools whose students showed 
sustained differences over grade level, but this time each graders perfomiance 
exceeded the national nomi, by five to 12 scaled score points. 
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Criterion Referenced Test in Mathematics 



Different forms of the Criterion Referenced Tests in Mathematics were given at 
each grade level, corresponding to the instructional objectives set for that grade. 
However, since different objectives were held for different grade levels, no attempt 
was made by the developers to calibrate the tests for comparative performance over 
grades. Differences in scores over grade level should be interpreted relative to 
students* percent of mastery of the objectives for the grade. Mean scores by school 
and grade on the CRT-Mathi are shown in Table 4.3. 

Once again students in School 1 showed a consistent pattern relative to the 
other schools-lowest in grade six, and plateauing or declining compared to other 
schools for students in grades seven and eight on the CRTs in mathematics. Students 
in School 2 demonstrated the same high-low-high pattem for its sixth versus seventh 
versus eighth graders respectively on the CRTs in mathematics as they did for the 
MAT'S \n reading and in mathematics, but for the CRTs the ''high's' did not exceed the 
means of the other schools. The pattem of means over grade level on the CRTs for 
students in School 4 showed them at or near the high end compared to other schools 
at all grade levels, but on the CRTs there was no inaease in perfomiance by seventh 
grade students in School 4 over sixth grade students in School 4. perhaps because 
their tests measured different objectives. 

School 3 was the only one of the four schools whose student perfomiance over 
grade level showed a very different pattem relative to other schools on the CRT*s 
versus the MAT'S. On the CRT's, School 3 students scored highest at both the sixth 
grade and the eighth grade levels. In the latter case the difference was significant; 
School 3 eighth graders taking the test showed 79.0% mastery of the objectives. 

Test of Problem Solving 

Mean raw scores by school and by grade on the Test of Problem Solving are 
presented in Table 4.4. All 972 students completing the TOPS are used in the 
analysis of the test's phychometric characteristics, which are reported in Chapter 5. 
However, due to very low rates of return for students in Schools 2 and 3, 21% and 
35% respectively, school-to-school comparisons are made only for Schools 1 and 4. 
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The same version of TOPS was administered at all three grade levels. As 
reported in Table 4.4 and pictured in Figure 4.4, School 4 shows sustained increases 
among its students over grade level, while in School 1 its seventh graders score 
higher than its sixth graders, but its eighth graders' scores plateau in comparison to 
seventh graders. The two-way, school k)y grade analysis of variance for students in 
Schools 1 and 4 produced a highly significant main effect for school (F»71.98, p < 
.0001), a significant main effect for grade (F-11.01, p < .0001), and no significant 
interaction effects. The same pattern of school-to-schooi differences between Schools 
1 and 4 favored School 4 at every grade level. 

Overall Differences in Achievement 

To summarize across test measures. School 1 ranks at or near the bottom 
compared to the other schools, and its students' perfontiance usually decline^ but not 
sharply so over grade level. Students in School 2 exhibit a variable pattern of 
achievement by grade, generally higher for sixth graders and eighth graders relative to 
students in the other schools, but this is most likely due to the exodus of higher 
achieving sixth grade students from School 2 to the prestigious € ramination schools 
in grade seven, the attrition of lower achieving seventh grade students from School 2, 
whose eighth grade class shows the highest shrinkage of the four schools. 

Students in School 3 show an inconsistent pattern of test performance over test 
measure; they score among the lower achieving schools on the MATs at most grade 
levels, but they average highest on the CRT in mathematics among sixth and eighth 
grades, where there is much 'teaching-to-the test.' Students at all grades in School 4 
score at or near the top compared to students in the other schools on almost every 
measure. The notable exception occurs in MAT-reading scores for sixth graders, who, 
like the students in schools 3 and 1 , score significantly lower than students in School 
2. Overall, School 4 presents profiles of higher student achievement with steady 
increases over grade level. 

Differences by Program 

It was noted eariier in this chapter that assignment to speda: programs within 
the schools is done largely on the basis of test scores. Test scores provide the 
exclusive basis for entry into p(*ograms at the sixth grade level. In some of the schools, 
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TABLE 4.6 

Summary of F Ratios for Significant Differences in Achievement Scores By School, 
Within Program, N's for Comparisons, and Duncan Tests of Mean Differences^ 



Measure of Regular Special Bilingual Combin. Advanced 
Achievement Program Ed. Ed. SE+BE Work Class 



MAT-Read 11.23"" 26.61" 

n-375 n-125 

1,3,2<4 1<2 



MAT-Math 21.50"" 5.35* 

n-376 n-123 

3,1<2<4 1<2 



CRT-Math 22.46"" 12.26" 

n-353 n-136 

1<2<3.4 1<2 



TOPS 25.86"" NS 

n-259 n-113 
1,3<4 
1<2 



NS NS 28.65"" 

n-557 n-20 n-121 

1<2 

5.24" NS NS 

n-545 n-19 n-121 
3,1<4 

21.40"" 4.27* NS 

n-433 n-j/ n-109 
1<2<4,3 1<2 

12.43"" NS 4.32* 

n-411 n-28 n-99 

1,2<4 1<2 
U3 



^Schools are designated School 1, School 2, School 3, and School 4. 



ERIC 



80 



teacher recommendations and grades are considered for student assignment to 
special programs at the seventh and eighth grade levels. But the special programs 
are not uniformly distributed across the four sdiools. Only Schools 1 and 2 have 
advanced work classes; these two schools also have bilingual education programs, 
School 1 for Hispanics, School 2 for speakers of i\sian languages. All four schools 
enroll students in regular programs and all four schools have special education 
programs, but Schools 3 and 4 have no special programs other than special 
education. The fairest comparison among schools is best made according to program. 

.^significant differences in the various measures of student achievement among 
schools within program are summarized in Table 4.6. In every comparison producing 
a significant difference involving School 4 (those for students in regular programs and 
in special education), School 4 pliced on the Ngh end or higher than the other 
Schools. In every comparison which produced a significant difference involving 
School 1. i.e.. for students in all five types of programs using all five achievement 
measures, students in School 1 ranked lowest. 

School 2 was significantly higher than School 1 on almost every measure for 
students in almost every comparison by program. Students in School 3 exhibited a 
variable pattern , significantly lower on some measures (MAT-Math, and MAT-Reading) 
than students enrolled in the same programs at some schools, significantly higher on 
another measure (CRT-Math) 

Overall, students' performance on traditional measures of achievement is 
lowest in School 1 and highest in School 4. whether the comparison is made for 
school overall by grade, or for schools within special programs. School 2 is cleariy 
superior in student achievement to School 1. but the difference betwet..< School 2 and 
School 3 is not as dear. 

Congelations Among Achievement Measures 

Another way of examining factors which contribute to student achievement is 
through regression analysis. Several were tried, but the alterable variables among the 
student data base, besides tests and grades, contributed very little to explained 
variance Instead, the simpler correlation matrix is presented here, showing 
correlations among tests and grades and other selected indicators of student 
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TABLE 4.7 

CORRELATION MATRIX FOR ACHIEVEMENT TEST SCORES AND FINAL GRADES 



Test scores Final Grades 



Measure 


MAT- 
Read 


MAT- 
Math 


CRT- 
Math 


TOPS 


Read 


Eng 


Math 


Sd 


SocSt 


MAT-Read 




.61 

(1243) 


.52 

(1051) 


.61 

(880) 


.17 

(923) 


.28 

(1210) 


.27 

(1271) 


.27 

(1070) 


.31 

(994) 


MAT-Math 




— 


.76 

(1045) 


.59 

(877) 


.36 

(911) 


.45 

(1198) 


.56 

(1250 


.39 

(1054) 


.44 

(983) 


CRT-Matti 








.53 

(791) 


.30 

(811) 


.42 

(1087) 


.63 

(1143) 


.39 

(976) 


.45 

(890) 


TOPS 










.22 

(744) 


.31 

(913) 


.32 

(969) 


.25 

(795) 


.31 

(733) 


FG-Reading 












.64 

(1131) 


.59 

(1170) 


.54 

(995) 


.61 

(1058) 


FG-Engllsh 














.61 

(1479) 


.67 

(1275) 


.67 

(1256) 


FG-Math 
















.59 

(1330) 


.59 

(1260) 


FG-Science 


















.64 

(1105) 



FG-SocStudles 



Note.-Numbers In parentheses are the number of pairs of data on which each 
coefficient was based. All coeffictents are significant at p < .0001 . 
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achievement. Rewards and punishments by the school and by teachers, and whether 
the students like school, are among the selected variables which are included in the 
discussion. 

Con^elation coefficients showing the relationships among tests and grades for 
students in all four schools are presented in Table 4.7. The three achievement tests 
correlate highly with each other. The correlation between the two tests of 
mathematics, one a norm-referenced test (MAT-Math), the other purportedly a criterion 
referenced test (CRT-Math), is very high, at .76. The standardized test of reading 
(MAT-Read) con^elates significantly with both tests of mathematics, .52 with the CRT- 
Math, and .61 with the MAT-Math. 

Grades correlate with gr des in the range from .55 to .67, no matter what 
subject is addressed. This suggjst that teachers are moderately consistent in the 
assignment of grades among students. In general, tests and grades do not correlate 
as highly as either types of measures do among themselves, nevertheless the 
intercorrelations between tests and grades are noteworthy. The highest, at .63, 
between final grades in mathematics and CRT-Math scores suggests the latter is really 
functioning as a critenon-referenced test. Even the standardized, norm referenced 
MAT-Math scores correlate moderately (.56) with mathematics grades. Both 
mathematics tests also shew correlations between .30 and .45 with all other grades, 
for science as well as for subjects in the humanities. 

Intercorrelations between MAT-Reading scores and grades were not nearly as 
high, ranging from .17 to a maximum of .31. The lowest correlation was observed for 
relationship between reading test scores and reading grades, a finding which 
surprised many observers. The con-elation was checked using different portions of the 
data base, by schools individually and by subgroups of the population. Still the 
correlations remained low, sometimes approaching zero. Even when students in 
special education and bilingual education were removed from analysis, on the 
argument that teachers might be grading more on effort than objective achievenent, 
the congelations between reading scores and reading grades remained low, usually 
between zero and .20, only once rising to .40 for students in tiie regular program and 
those in advanced classes in School 4. The MAT-Reading scores con^elated more 
highly with other grades than with reading grades, consistently .27 with English, 
mathematics, and science grades and .31 with social studies grades. 
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MAT*Reading scores have assumed enormous importance in the Boston Public 
Schools. They are used oftentimes exclusively as the basis for student assignment to 
programs; scores below an eighth grade level disqualify students for graduation. New 
scores are heralded each June in local newspapers and the success or failure of the 
system is seen to coincide with rising or falling MAT reading scores. The finding that 
reading scores and teachers' judgements of how well their students are doing in 
reading have almost no overlap is alarming at best. 

Rewards and Punishments in Relation to Achievement 

Students* r^^ports of rewards and punishments given to them by the school and 
by teachers showti noteworthy correlations with test scores and with grades. 
Students who reporter' being suspended in the current school year were likely to have 
lower grades (the meoi^ ^ correlation was -.20 between suspension arxJ grades), but 
the correlations tatwaen suspensions and test scores dropped to below .10. 
Similarly, students whom teachers punished a lot were less likely to receive good 
grade.^; here the correlations were even stronger, ranging from *.20 to *.31, but the 
correlation between being punished and test scores dropped down to .04. Similarly, 
tiiere were low t>ut significant correlations, around .20, between grades and rewards, 
by tiie school and by tead ''rs, but lower or no correlation between rewards and tests. 
It would appear that teachers are including behavior as well as academic achievement 
in their criteria for grades. 

Students who report liking school are slightiy more likely to get higher grades. 
The median correlation for all subject areas is .15, but the correlation drops to .05 
between liking school and performance on tests. 

Finally, tiiere is a factor score derived from the stijdent questionnaire which is 
reported more fully in Chapter 10. The factor measures the student's perception of 
whether their teachers are promoting competition for grades, getting higher tests 
scores, and working independentiy-the opposite of cooperative leaming. Scores on 
this fc^ctor correla* . negatively with test scores, ranging from -.21 for the MAT-Math to - 
.24 for MAT-Reading. 
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A Longitudinal Perspective on School Differences in Academic Achievement. 

The data for this study which come from the student questionnaire are cross- 
sectional; funding could not be secured to monitor changes in these schools over 
time. Nonetheless, it was possit^le to pull from the larger sample those eighth grade 
students who reported attending their present school since the sixth grade. Since 
there are great shifts from year to year in the populations of students attending these 
schools, it is important to look at those students who have sustained enrollment in 
their schools from grades six through eight. The attraction to the city's more 
prestigious examination schools is assumed to affect ail four schools but those schools 
vtAth advanced work classes have larger numbers of academically talented students 
and so will be affected even more. Looking at the eighth graders who didn't move to 
exam schools in grade seven and who have enrolled in their schools for three years 
provides a way to asses the schools' sustained contribution to student achievement 
more fairly. 

Results of one-way analyses of variance by school using the various 
achievement measures as dependent variables and only eighth graders as subjects 
are summarized in Table 4.8. All four analyses produced significant F ratios. Students 
at School 4 were consistently in the top group on every achievement measure. 
Students at School 2, claimed by its principal to be the flagship of Boston middle 
schools, did not do as well as their press; they performed best on the MAT- 
Mathematics, but not signifk:antly better than the eighth grade students in School 4. 
The performance of eighth grade st. dents from School 2 on the new measure of 
problem solving (which will b^ introduced in the next chapter) was lowest of all. While 
students in School 4 were consistently in the top group, students in School 1 were 
consistently on the negative side of significant differences. Eighth grade studen J in 
School three for three years generally did more pooriy than others but they excelled 
on the CRT-Mathematics. It can be said that the analyses by school which were 
limited to eighth graders who had been at their schools for ttiree years showed the 
same pattern of high and low achievement which was reported for their school overall. 
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TABLE 4.8 



Means, Standard Deviations, and Significant F Ratios for Differences in Achievement 
Scores by School and Duncan Tests of Mean Differeiices Among Eighth 
Graders Who IHave Attended Their School for Three Years 



Achievement School 1 School 2 School 3 School 4 
Measure 



MAT-Read 644.6 658.6 641.4 660.2 2.39" 

(38.22) (44.27) (27.60) (46.84) 

n-87 n-31 n-16 n-67 3,1<4 



MAT-Math 641.4 671.5 646.9 fac3.6 8.24* 

(29.49) (33.42) (35.^3) (45.20) 



n-81 



•o<.01 
*p<.0001 
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n-31 n-16 n-66 1,3<4,2 



CRT-Math 49.83 67.31 77.03 72.24 25.60"** 

(17.80) (14.92) (13.52) (14.79) 

n-74 n-39 n-12 n-49 1<2,4,3 



TOPS 16.47 16.33 17.94 21.90 9.71"" 

(6.17) (5.97) (5.08) (4.87) « , « ^ 

n-64 n-24 n-16 n-53 2,1,3<4 
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Summary 



The Boston Public Schools had instituted a program of extensive testing of 
students with Metropolitan Achievement Test (MAT) subtests in reading and 
mathematics, systeoi-wide a;terion referenced tests (CRTs) in four subject areas, as 
well as a writing sample. All of these measures were to have been used for analysis in 
the present study. However in the year of data collection for the study, 1989. the 
schools cut back on the quantity of testing, limiting test administa'ation to the use of tiie 
two MAT subtests and the CRT in matiiemati'cs only. Only some schools collected and 
scored a writing sample, whose grade was supposed to be incorporated into the final 
grade in English. A new measure of high order tiiinking call Test of Problem Solving, 
or TOPS was administered with representative results from two of the four schools.. 

Since tiie criterion-referencod tests which were preferred for the present study 
as measures rrore closely aligned with the goals of instruction were no longer bei i 
used, we elected to examine teachers' final grades in acadt^mic subjects. Teacher 
grades are idiosyncratic, because teachers are known to use a variety of methods and 
criteria for assessing student pciromnance. Grade to grade or school to school 
comparisons are virtually meaningless indicators of school differences. But grades 
have some utility in correlational analyses with test data and students' reports of 
rewards and punishments by tiie school and by teachers. 

Several kunds of analyses were reported for the student achievement data. 
First, descriptive statistics and graphic representation of mean scores were presented 
for all four achievement test measures. Then two-way analyses of variance by school 
and by grade-were summarized. For all measures, school differences were highly 
significant, as were most grade differences, but so were the interaction effects for these 
two factors. School to school differences had to be qualified according to grade level. 

School 1 showed the same pattern of performance relative to the otiier schools 
on all measures of achievement, it ranked at or near the bottom, and its students* 
perfomnance declined, but not sharply, over grade levels. School 2 had consistent 
profiles for comparisons on each achievement measure; in each case student 
perfomnance dropped predpitously from grade six to grade seven, ti^en rose sharply in 
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grade eight. The most plausible reasons for this pattern were that better students left 
School 2 after grade six to attend the more prestigious examination schools in the 
system, and that lower achieving students dropped out after grade seven. School 3 
showed very variable patterns on different measures of achievement. Schiool 4 
stuaents were consistently at or near the top on all achievement measures at all grade 
levels txjt one; reading scores for their sixth grade students were lower than those of 
School 2. 

Since tracking occurs in the schools through student assignment to special 
programs, it was decided that a fairer way to compare the schools was program by 
program. All four schools had students assigned to regular programs vAVn no special 
intervention, and all four schools had special education programs. Only Schools 1 
and 2 had bilingual programs. School 1 for Hispanics, and School 2 for speakers of 
Asian languages. Also, Schools 1 and 2. were the only ones with advanced work 
classes. In analyses by programs where all four schools couki be compared. School 4 
was consistently among the highest for which significant differences were found, and 
School 1 was consistently at the bottom or among the combination of schools 
anchoring the low end. The pattern of highs and lows for School 3 was erratic, but 
most often School 3 ranked among the lower achieving schools. Students in School 2 
performed higher than students in School 1 on every achievement variable in every 
analysis, overall, by grade, and by program. 

Correlations among achievement measures showed that regardless of subject, 
grades correlate with grades and test scores correlate with test scores, producing 
moderate to high con-elation coefficients ranging from .52 to .76. Scores on the CRT 
and the MAT in mathematics correlated .76 and .61 respectively with final grades in 
mathematics. Intercorrelations between reading test scores and grades were not 
nearly as high, ranging from .17 to a maximum of .31. The finding that test scores and 
final grades in reading correlate only .17 was alarming to most observers who know 
the stress assigned to reading scores in the placement and promotion of students in 
the Boston Public School system. 

Students' reports of rewards and punishments accorded to them by the school 
and by teachers showed noteworthy correlations with test scores and with grades. 
Students who reported having been suspended or punished by teachers tended to 
have lower grades, but their test scores did not distinguish their achievement from 

88 

ERIC qv 



those of students who reported no suspensions or other punishments. Students who 
reported being rewarded by the school or by teachers tended to have somewhat 
higher grades, but the con-eiation did not hold for test scores. Students who thought 
their teachers promoted competition among students actually did more poorly on 
tests. 

Finally, since funds could not be obtained to conduct a longitudinal study in the 
schools, it was decided to pull from the larger sample those eighth grade students who 
reported attending their present school since the sixth grade. This strategy enabled 
investigation of the schools' influence on student achievement over time. Results from 
these analyses confirmed those reported earlier. School differences in achievement 
showed the same pattems when the analyses were limited to eighth graders who had 
attended their schools for three years as they did for students overall. 
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CHAPTER 5 



BEYOND BASICS: ASSESSMENT OF HIGHER ORDER THINKING 

The Importance of Higher Order Thinking 

Highly critical of the education being offered to students in middle grades in 
many of this country's schools, the Carnegie Council on Adolescent Development 
charged that: 'Nowhere is this failure more evident than in the development of 
American young adolescents* critical reascning and higher order thinking.' The 
criticism is not a new one in substance, but it has become more intense. Under 
various labels, exhortations to teach for 'critical thinking,' 'higher order cognitive 
functioning,' and 'complex problem solving,' have been voiced for decades 
(Anderson, Marcham & Dunn, 1944; Dewey, 1910; Follman, Brown & Burg, 1970; 
Guilford, 1965; Gantt, 1970; Shann, 1976; Swick 4 Miller, 1975). Neariy twenty years 
ago. Skinner (1971) warned that critical thinking is important because it helps students 
learn how to deal with rapid sodetai change, put new knowledge to use, and make 
decisions. 

What has changed dramatically is the way we gauge our society's productivity. 
No longer are we in an indusbiai age, but rather an age of infomiation technology, in 
which many people need to make a living by thinking, and net by rote assembly. 
Educational goals and objectives previously reserved for the elite are now being held 
for the masses. Resnick points this out in her historical perspective on the revival of 
teaching higher order skills which had previously been the focus of the academies: 
'Today, we are committed to educating all Americans in the secondary schools and a 
large proportion (higher than any other counti7 in tho worid) in some form of 
postsecondary institution. These students' educational needs cannot be met by 
traditional vocational programs that no longer prepare students for productive 
participation in an increasingly diversified economic environment. Employers today 
complain that they cannot count on schools and colleges to produce young people 
who can move easily into more complex kinds of wori< (Resnick, 1987, p. 6).' 

Fueling tiiis renewed interest in teaching for higher order thinking skills is 'the 
single most important message of modern research on the nature of thinking' 
(Resnick, 1987, p. 8) thattiie kinds of processes traditionally associated with higher 
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order thinking are not limited to advanced levels of development. Contrary to 
widespread conventional belief, cognitive development during eariy adolescence is 
not in latency during this period of rapid physical change. The recently prevailing 
notion to the contrary has had f .ibstantial and damaging effects on middle grade 
education by limiting the development of innovative cunicula to promote higher order 
thinking. A thorough review of recent studies of cognitive development in adolescence 
found no persuasive evidence that young adolescents are irx;apat}ie of higher order 
skills (Graber & Petersen, 1990). 

In fact the term 'higher order' skills is fundamentally misleading, because it 
suggests that lower order skills need to come first in a very lineai fashion. The 
growing body of research in cognitive science on the acquisition <^ thinking skills 
particulariy in reading, but also mathematics, attests to this finding. Long years of drill 
on the 'basics' before thinking and problem solving are required can no longer be 
justified. 

Yet. higher order thinking and critical reasoning have not being taught 
extensively, probably because teachers are unprepared to teach it wel! (Woods & 
Walton: Henderson, 1972). Pervasive use of standardized tests of basic skills as the 
primary vehicle for accountability no dout}t contributes to the problem. Despite the 
reason, the outcome is well documented; both the National Assessment of Educational 
Progress (1985) and the National Commission on Excellence in Education (1983) 
have presented data showing that schoolchildren in this country do learn large 
amounts of information, but they do less wel! on what are variously called the 'higher 
order skills' or the metacognitive skills-how to analyze, synthesize, and evaluate that 
information for their own use. 

The Problem of Definition 

Defining higher order cognitive functioning is the first problem which writers on 
the topic must address. Disciplinary perspectives often color their choice of terms; 
philosophers promote logical thinking and critical reasoning: developmental 
psychologists point to metacognition; educators advocate teaching study skills and 
real life problem solving; cognitive scientists focus on cognitive strategies and 
heuristics for problem solving. 
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Fifteen years ago. the more widely used label was 'probiem solving" but the 
interpretations were just as various (Shann, 1976). Problem solving in writings on 
education philosophy and on philosophy of sdenca reflected views of problem solving 
as logical thinking (Dewey, 1910) afid the scientific method (e.g., Cohen & Nagel, 
1934; Nagel, 1981; Hempel, 1966; Foster & Martin, 1966; and Martin, 1972). 
Psychologists thoorizing on problem solving postulated models of the process which 
seemed to follow either of two approaches: one, the identification of subgroups of the 
intellectual processes whose linkages may be of the linear or feedback variety 
(Johnson, 1962; Menifield, Guilford, Christensen, & Frick, 1962; Gagne, 1956, 1964; 
Feldhusen, Houtz & Ringenback, 1972); and another, the analysis of problem solving 
processes through information processing analysis of complex skills (Newell & 
Simon, 1972; Simon, 1976). 

Some of the more recent research on higher order skills and problem solving 
has been interdisciplinary, marking advancements in cognitive science. This 
interdisciplinary movement has joined psychologists, educators, computer scientists, 
philosophers, linguists, and neurologists, among others attempting to look into the 
thinking mind, figuratively at least, and study the nature of human thinking and the 
process of reasoning. Still, the question of generalizat)ility of higher order thinking 
skills across disciplines has been the subject of much debate (Ennis, 1989; Glaser 
1984; McPeck, 1981; Morris, 1989; Orton, 1988; Paul, 1985; Perkins & Salomon, 1989; 
Resnick, 1987). 

A strong critic of the generalizability of thinking skills, McPeck (1981) argued 
that each field of inquiry has its own particular epistemology. Wasserman (1989) 
made a useful distinction between 'some acts of ttiinking which can be observed in 
logical, problem^solving patterns of behaviors" from others which "come out of highly 
intuitive, almost magical, insights or intuitive leaps." Empirical studies of higher order 
ttiinking by scientists solving problems (Laridn, et al., 1980), expert writers composing 
an essay (Bereiter & Scardamaiia, 1982; Flower & Hayes, 1980), social scientists 
developing proposals, and skilled technicians repairing equipment (de Kleer & Brown, 
1980) all show ttiat certain kinds of strategies recur. The expert reconstructs the 
problem in new forms, examines the logic of proposed solutions, anticipates the 
implications, makes modifications, and reasons by analogy to similar situations. 
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The literature is replete with lists of the steps of prolslem solving derived by 
logical analysis. Most owe their origins to Dewey's 'five logically distinct steps' of the 
prot)lem solving process: 'i) a felt difficulty: 2) its location and definition: 3) suggestion 
of possilsle solution: 4) development by reasoning of the bearings of the suggestion; 
and 5) further observation and experiment leading to its acceptance or rejection, that is 
the conclusion of belief or disbelief (Dewey, 1910, pp 72-77). The resilience of 
Dewey's theory was attested by Guilford. In his analysis of creative production, 
Guilford (196b, p. 8) compared several then recent theories and concluded that 'the 
most remari(at>le thing about them was their similarity to that of Dewey.' 

The same assessment might be applied to analytical framewori<s developed 
more than two decades later. Rankin and Hughes (1987) suggested that 'the major 
thinking processes have much in common.' Their framework of thinking skills 
identified a generic process with seven steps or stages that a person goes through 
when he or she thinks: 1 ) focusing, 2) gathering information, 3)organizing information, 
4) analyzing information, 5) generating ideas, 6) synthesizing, and 7) evaluating and 
applying. As Resnick observed, 'The search for general learning skills is not a new 
one.... (but ) Psychological research gives us reason to believe in the reality of 
general skills for learning as well as reason to maintain a degree of skepticism' 
(Resnick, 1987, p. 16). 

Resnick's definition of higher order skills provides a fine complement to so 
many other definitions which emphasize the component processes. Her 
comprehensive yet succinct definition calls attention to the atta-lbutes of the problem 
situation and the reactions of the thinker as well. 

Higher order thinking involves a duster of elaborate mental 
activities requiring nuanced judgement and analysis of complex 
situations according to multiple criteria. Higher order thinking is 
effortfi^ and depends on self-regulation. The path of action or correct 
answers are not fully specified in advance. The tivnker's task is to 
construct meaning arxi impose stivcture on situations raffier than to 
expect to find them already ^arenf (Resnick, 1987, p. 44). 
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The Probiem of Measurement 

All SO states use nationally normed standardized tests of basic skills (Cannell. 
1988). But the major criticism of these tests, as well as those constructed by teachers, 
is that they emphasize recall of declarative or procedural knowledge, net the level or 
quality of stude.ifs thinking (Fleming & Chambers, 1983; Morgenstem & Renner, 
1984). Many experts on educational testing and polk:y attest that tests serve i causal 
function in shaping instruction. Indeed, measurement driven instruction is no secret 
(Airasian, 1988; Brown, 1989; Dariing-Hammond & Wise, 1985; Madaus, 1988; 
Meisels, 1989; Popham, 1987). 

Nickerson (1989) cites two compelling reasons for testing thinking: one is to 
determine how effectively thinking is being taught, the second is to ensure that it is. 
Several states have mandated both the teaching and testing of higher*order cognitive 
skills in their schools, but the mandate outstrips the availability of appropriate 
measuring devices if not knowledgeable practice as well. If tests are to be widely 
used, they have to be easily administered and easily scored, that is, efficient and 
reliable. Operationally, these requirements translate into the use of highly structured, 
usually multiple choice items with single-right-answer formats. But as critics have 
pointed out, problems in the real worid often defy simple structure and single solutions. 

Toward A Solution 

Cleariy a dilemma exists between the implications of measurement driven 
instnjction and the inherent limitations of multiple choice testing. Wiggins (1989). 
persuaded by the incentives of teaching for the test, has suggested that we "design 
and then teach to standard- setting tests so that practicing for and taking the tests 
actually enhances rather than impedes education.' Some would applaud his 
impatience, but others voice extreme caution: 

\..ifwB believe that thinking is a set of very complex, sophisticated, 
and intenrelated functions: that some acts of thinking are logical and 
others highly intuitive: that creative thinking rarely follows an orderly 
pattem: that there are degrees of creative and problem-solving 
capability Ihst are not constant: that there is variation of performance 
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within individuals; and that in spite of many seminal tomes written on 
the topic of blinking, much ambiguity remains with respect to 'good 
tNnking, ' we are hkely to need much, much more work before we 
dare to enter the realm of measurement. And we ought to very, 
very wary of those errthusiasts who woukl lead us to measurement 
before the debate has been settled' (Wasserman 1988, p. 368). 

This researcher decided some yeirs ago to err on the side of impatirnce, 
developing and pilot testing efficient paper and pencil measures, while creating 
simulated challenges for solution by small groups, and protocols for intensive case 
studies of individual learners as they engage more complex and extended problems 
(Shann, 1976). While all of these approaches continue to have their advantages and 
disadvantages, the economy and efficiency cf the paper and pencil approach were 
very important considerations for this research on urban middle schools. The 
previously piloted paper*and-pencil tests would have to be revised and up dated, but 
at least they would provide a start. The group challenges and individual protocols 
tapped more complex, higher order cognitive skills but their use required intensive 
observation of extended cognitive tasks and required considerable judgement in 
scoring. Especially in the disadvantaged urban schools which constituted the sample 
for the present study, it was importarrt to know if students could at least analyze and 
evaluate the simpler problem scenarios which were presented in the paper-and*pencil 
tests. 

The instructional goals which the original tests were designed to measure were 
fomiulated as behavioral objectives-that the student would: 

* identify and define the problem; 

* decide what information and investigations were needed in order to 

find some solution to the problem; 

- determine what needed to be done first 

- decide what was the best way to obtain the information needed; 

- detect flaws in data gathering procedures or errors in the data 

themselves; 

- organize, analyze, and interpret the data; 

- suggest some solution to the problem based on the data; 

- suggest ways to implement the solution (Shann, 1976, p. 65). 
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The strategy used to measure these outcomes was to develop scenarios 
portraying realistic, everyday problems which might hold high interest for the middle 
school age group. Sets of items were written which were context-dependent. The 
tasks required critical thinking and scientific reasoning rather than the recall of factual 
Information. The science/mathematics orientation of the tests would provide a 
complement to the assessment of more intuitive, aeative production which the writing 
sample was to afford. In addition, the effort to assess higher order thinking in 
scientific prot}lem solving was consistent with the national agenda set by 'the 
education president' to make American students best in tiie worid in tiieir performance 
in matiiemati'cs and science (Bush, 1990). 

The test content would also be consistent with recommendations made by the 
ATierican Association for the Advancement of Science in their landmark report. 
Science .'or All Americans (1989). In particular, the skills measured by the test would 
target what practices science teachers were urged to strass with middle school 
students: 

- Start with questions tiiat are interesting and familiar to students. 

- Engage students actively in collecting, sorting, sketching, interviewing, 
using equipment, and systematically obsen/ing behavior. 

- Concentrate on tiie collection and use of evidence. 

- Insist on dear, effective oral and written communication. 

- Use a team approach. 

- Do not separate conclusions from methods, knowing from finding out. 

- Oe-emphasize tiie memorization of technical vocabulary in favor of 

understanding important concepts. 

The New, Revised Measure of Higher Order Thinking 

The measure of higher order tiiinking in its original fomi was given in two parts, 
the first containing 30 items on five scenarios, tiie second containing 16 items on three 
scenarios. The reading difficulty of tiie test was targeted for administration with 
students in grades 4 through 8 (Shann, 1976, 1977a, 1977b). Used in tiie national 
evaluation of the cuniculum called 'Unified Science and Matiiemati'cs for Elementary 
Schools' at 40 schools in 18 states, tiie original test yielded scores which showed 
predicted increases in skills over grade level, and was further validated against 
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teacher judgements of iheir students* abilities in problem solving. Internal consistency 
reliability for the 46-item test using Hoyt's estimate was .86. Shortened versions 
maintained respectable levels, .79 for a 30-item test and .74 for a 16-item test. 

The test was revised according to the recommendations made in the previous 
study (Shann, 1976); Questions with poor item statistics were dropped; new items 
were created, but the general format context-dependent items centered around a 
realistic scenario was retained. In addition, the language was updated. Children's 
names and surnames were varied to reflect the predorrinantiy black and Hispanic 
student enrollments in the sample schools of the present project. The new test was 
named TOPS, or Test of Problem Solving, It contained 31 items on five scenarios and 
was pilot tested in the same scnools which had generously allowed their sixth grade 
classes to take pilot versions of the student questionnaire. At the end of the pilot 
sessions, students were asked which scenarios were rrK)st interesting, and which wer3 
least interesting. Since class time and students' attention spans were among our 
concerns, we wanted to put tiie high interest items first, and the low interest and 
perhaps more difficult items last. The students' reactions guided the order of 
placement of the five scenarios chosen for the final, revised edition. 

The revised edition of TOPS is shown in Appendix C. It contains five items each 
on tiie following topics: "Pets in tiie Classroom;" 'Bike Transportation;" The Window 
Sill Garden;" and 'A Busy Comer." The final set called "A Classroom Temperature 
Chart " coniains six items. As was tiie case with the student questionnaire, Spanish 
and Vietiiamese translations of TOPS were obtained, in order to maximize tiie rate of 
useful returns. 

Adminiirtration of TOPS 

TOPS was administered in each school during the students' science periods. 
Since tiiese times varied, we were not able to collect data from the entire school at one 
sitting, as had been tiie case with tiie student questionnaire. Instead, tiie insti^uments 
were delivered to the schools and administered by teachers during tiie days allocated 
for testing with TOPS. Optic al scan answer sheets, preceded v^tii tiie stijdent's name 
and six-digit identification code, were given to the students along with the TOPS 
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booklet. The answer sheet reflected the familiar format used by the school for many 
other testing purposes. 

While the number of usable retums was substantial, at 972, it war significantly 
lower than 1583, tie number of usable retums from the student questionnaire. Much 
of the attrition was attributed to one school which changed its procedure for gaining 
parents' or guardiaa.. permission for testing. In the case of the student questionnaire, 
which was administered first, the school, using our suggested form letter, notified 
parents that administration had been scheduled, and if they did not wish their sons or 
daughters to participate, they should notify the school. For the administration of 
TOPS, the principal decided to collect signed permissions from parents and allow only 
those students who returned slips to take the test. Other factors contributing to the 
attrition were complaints from teachers that the test was 'too hard' for the students, and 
those groups having trouble would not respond. Casual inquiry determined that the 
same response was typical for participation on other t^st measures. 

We had also requested that teachers rank order their students in these classes 
with respect to the students' problem solving skills; we asked t^iat the teachers do this 
as their student were taking the test. Two schools forgot to give the rating instructions 
to the teachers, and the data could not ba reclaimed at a late: time. Intmsions on the 
schools' schedule had become more and more numerous, especially for testing, and 
additional requests of teachers were not advised. 

Scoring 

The optical scan answer sheets were scored by the Boston Public School 
System's Bureau of Research. Item responses and the six-digit code were provided 
on tape to the principal investigator. The total number of usable retums was 972; the 
distribution of usable responses by school was: School 1-496. School 2-127, 
School 3-95, and School 4-254. 
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Technical Characteristics of TOPS 

Several technical aspects were studied to appraise the psychometric qualities 
of TOPS: item analysis, subtest analysis, reliat>ility and validity. But even before 
results of these analyses are reported, it is instructive to note the shape of the 
distribution of total correct scores for the 972 taking TOPS. Shown in the left half of 
Table 5.1, the frequency distribution of TOPS scores is symmetrical, suggesting an 
underiying norma? curve. 

Item Analysis 

Item analysis included the determination of item difficulty and item 
discrimination levels, as well as item-total correlations using serial and point biserial 
methods. The difficulty levels and disaimination indices are reported in the right half 
of Table 5.1. The difficulty levels represented a broad range, the easiest answered 
correctly by 91% of the students, and the most difficult answered correctly by only 23%. 
The wide range of item difficulty levels are needed to yield a rK>mrial distribution of 
total test scores, although there was no detemnination in advance to promote this kind 
of score distribution. Discrimination indices ranged from .17 to .68. In general, the 
low values were observed for the more difficult items. Most discrimination indices 
were moderate or better, ranging from .50 and up. 

Subtest Analysis 

Results of the analysis of five sut>tests in TOPS are summarized in Table 5.2. 
Eac^l of the five subtests showed moderate to moderately high internal consistency 
reliability coefficients as detemnined by Cronbach's alpha. The values ranging from 
.50 to .67 are considered quite good for 6- and 7*items subtests. The means reported 
in Table 5.2 for each sut>test indicate that students dkJ best on the first and second sets 
of items based on the scenarios for Pets in the Classroom and Bike Transportation 
respectively. These were so placed because students in the pilot test rated them of 
highest interest. The pattern of decreasing means by subtest may indicate 
increasingly more difficult items, or scenarios of lower interest, or fatigue, or some 
combination of these. The increasing standard deviations over subtests indicate that 
st ident perfomnance became more variable as students proceeded through the test. 
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TABLE 5.1 

Distribution of Total Scores on TOPS and Item Analysis Data for TOPS Items 



Descriptive Statistics Item Analysis 



Score n Percent Cumulative ltem# Difficulty Discrimination 

Percent Level Index 



1 


1 


.1 


.1 


1 


.89 


.28 


2 


2 


.2 


.3 


2 


.88 


.26 


3 


2 


.2 


.5 


3 


.64 


.57 


4 


5 


.5 


1.0 


4 


.86 


.31 


5 


9 


.9 


2.0 


5 


58 


.47 


6 


17 


1.7 


C.7 


6 


.63 


.33 


7 


10 


1.0 


4.7 


7 


.71 


.51 


8 


21 


2.2 


6.9 


8 


.69 


.35 


9 


32 


3.3 


10.2 


9 


.65 


.43 


10 


28 


2.9 


13.1 


10 


.35 


.23 


11 


48 


4.9 


18.0 


11 


.91 


.27 


12 


48 


4.9 


22.9 


12 


.54 


.50 


13 


35 


3.6 


26.5 


13 


.71 


.52 


14 


47 


4.8 


31.4 


14 


.59 


.55 


15 


42 


4.3 


35.7 


15 


.27 


.19 


16 


43 


4.4 


40.1 


16 


.66 


.57 


17 


53 


5.5 


45.6 


17 


.49 


.46 


18 


49 


5.0 


50.6 


18 


.45 


.48 


19 


56 


5.8 


56.4 


19 


.62 


.61 


20 


66 


6.8 


63.2 


20 


.47 


.45 


21 


54 


5.6 


68.7 


21 


.63 


.60 


22 


69 


7.1 


75.8 


22 


.72 


.61 


23 


60 


6.2 


82.0 


23 


.45 


.40 


24 


46 


4.7 


86.7 


24 


.50 


.51 


25 


49 


5.0 


91.8 


25 


.81 


.58 


26 


28 


2.9 


94.7 


26 


.63 


.57 


27 


24 


2.6 


97.1 


27 


.23 


.17 


28 


19 


2.0 


99.1 


28 


.72 


.59 


29 


6 


.6 


99.7 


29 


.31 


.18 


30 


2 


.2 


99.9 


30 


.54 


.59 


31 


1 


.1 


100.0 


31 


.59 


.68 
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TABLE 5.2 

Descriptive Statistics and Alpha Reliability Coefficients for TOPS Subtests 



Name of Subtest X s Mdn # items Alpha 

Pets in the Classroom 4.42 1.38 5 6 .54 

Bike Transportation 3.77 1.45 4 6 .50 

Window Sill Garden 3.04 1.67 3 6 .60 

A Busy Comer 3.11 1.72 3 6 .61 

Classroom Temperature 3.38 1.91 4 7 .67 

TOTAL TEST 17.72 5.95 18 31 .84 



Reliability 

Reliability for the total test as determined by Cronbach's alpha was .84. This 
figure compares very favorably with internal consistency reliability coefficients ranging 
from .76 to .83 which have been reported for the Watson-Glaser Critical Thinking Test 
(1980). While it woukj have been desirable to establish test-retest reliability for TOPS, 
a second administration with TOPS was not as important as gathering addv ional kinds 
of information on school effectiveness. Due to the schools' extreme reluctance to 
consent to additional testing, compounded by the difficulties of additional test 
development, equivalent forms reliability was not attempted; it was beyond the scope 
of the project. 
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Validity 



Validity for the TOPS was established primarily through content analysis, and to 
a certain extent through construct validation. (If an appropriate criterion were readily 
availatdle for the determination of concurrent or predictive validity, the development of 
TOPS v«fould not have been needed.) Several opportunities were used to gather 
critiques of TOPS from graduate students in science and mathematics, from middle 
and secondary school teachers of these and other subjects, ar^ from professors of 
education, psychology, and related disciplines. 

Individuals were asked to assess the face validity of items and to review the 
items in relation to the expressed objectives measured by the test. Reviewers 
affirmed that the test items measured the stated objectives, and the eariiar inquiry 
regarding what the test appears to be measuring produced the following kinds of 
responses: 'the logic of arguments, the validity of experiments; interpretation of 
graphs; syllogistic reasoning; scientific reasoning; appropriate order of steps; 
establishment of priorities; appropriateness of hypotheses; design of experiments; 
ano evaluation of evidence; ' but also 'reading comprehension and endurance.' The 
graduate student reviewers, freer with their personal reactions than the practicing 
teachers or professors, remari<ed: 'You have to think about these!'; 'The answers are 
not immediately obvious; ' and 'What is the right answer to this one?' And indeed, in 
some cases best, rather than plausible, answers were keyed. 

Teacher ratings of their students' performance on tasks of complex problem 
solving were to have been used as the most important criterion for judging the validity 
of TOPS. As had been done with the original test (Shann, 1976), and indeed by Binet 
in his validation of the first intelligence test (1904), teachers were asked to rate their 
students after having had opportunities to observe their processes and performance 
at dose hand over several months. The rating instructions for teachers are given In 
.^ppendix C.4. Unfortunately, two of the schools forgot to ask their science teachers 
to provkje their ratings when their students were taking the instruments. The school 
with the largest number of students and the lowest performing students did comply 
with the request, but some of the teachers invented their own scales, rating the 
students from one to three, instead of rank ordering from one to 'n', 'n' being the 
number of chikjren in the dass. 
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It was predicted that student performance on TOPS would increase over grade 
level. The implications of this finding for the validity of TOPS are less dear in light of 
recent evidence that higher order skills are not strictly linear. But the more important 
limitation of this evidence for the present study is the fact that the student populations 
change from year to year, especially from grade six to grade seven, when more able 
students leave the middle schools to enter the examination schools which are the most 
prestigious in the system. There is lesser txit still persuasive evidence that lower 
achieving students are dropping out, truant, or not taking the tests at the eighth grade 
level, when one of the schools shoots up in its measures of student performance. 
These population shifts and the need for more careful clarification make the grade to 
grade differences in TOPS scores less persuasive as evidence for the construct 
validity of TOPS. 

Stepwise Multiple Regression Analyses Predicting TOPS Scores 

The matrix of con-elations among TOPS scores, other test scores, grades, and 
student questionnaire responses was studied for associations. A part of this matrix is 
reproduced in Table 5.3, along with means and standard deviations of the selected 
variables. All of the achievement data, i.e., test scores and grades, plus two factors 
derived from the students' responses to items on the questionnaire about teaching 
practices were entered into stepwise regression, with pairwise deletion of missing 
data. Only the test scores made significant contributior» to the explanation of variance 
in TOPS scores. A second stepwise 'egression analysis was run using the test scores 
in combination with school and grade to predict TOPS. The latter two factors were 
coded as dummy variables and entered as blocks for each factor. Results of this 
analysis are shown in Table 5.4. 

MAT-Reading test scores explained the highest amount of variance in TOPS 
scores, fully 37%. MAT-Mathematics subtest scores contributed another 9% to 
explained variance, bringing the total for the two predictors to an r2 of .45. Not being 
in School 1 , the lowest achieving of the four schools, contributed another 2% to 
explained variance. While additional school and grade placements made additional 
contributions which were statistically significant, the infomnation was of no practical 
significance, adding only 1% or less to explained variance. The CRT in mathematics 
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TABLS 5.3 

Means. Standard Deviations, and Con-elation Matrix for Achievement Data 



Tbsl X s n TOPS CRT MAT-Math 



TOPS 


17.72 


5.93 


972 








CRT-Math 


57.71 


20.21 


1145 


.533 






MAT-Math 


647.65 


39.09 


1265 


.590 


.764 




MAT-Read 


642.95 


45.81 


1279 


.610 


.534 


.606 



TABLE 5.4 

Stepwise Regression Analysis Predicting TOPS Scores 



Predictor Variable 


b 


Beta 


T 


r2 after entry 


MAT-Reading 


.050 


.382 


11.81"" 


.37 


MAT-Mathematics 


.039 


257 


5.67"" 


.45 


School 1 


-2.709 


-.223 


-6.31"" 


.47 


Grade 6 


-1.247 


-.102 


-4.00"" 


.48 


School 2 


-1.667 


-.123 


-3.68"" 


.41 


School 3 


-1.560 


-.090 


-2.83" 


.49 


CRT-Mathematics 


028 


.095 


2.19* 


.49 



Constant: - -39.142 
R2-.494. p<.0001 (R-.703) 



•p < .05 
"p<.01 
"*p < .001 
""p < .0001 
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added virtually no new information because it correlated highly (.76) with the MAT 
mathematics sutstest, which took their shared variance first. 

While some mathematics skills are apparent in TOPS, it is much more a test of 
reasoning. The last of the five subtests, 'A Classroom Temperature Chart', 
emphasized the irrterpretation of numeric information from a chart, but it also required 
reasoning. Only three other '^eins on the test required interpretations from graphs and 
charts; the others required thinking and reasoning which dealt with other content. 

If the TOPS is a measure of higher order thinking and critical reasoning, the fact 
that it shares 37% of its variance in common with a measure of reading 
comprehension is consistent with explanations of the components of critical thinking 
offered by previous researchers. In reviewing the literature, Henderson (1972) found 
that the two major components of critical thinking are understanding the meaning of 
words in relation to the context, arxJ evaluating whether the conclusion is appropriate. 
Folman and Lowe (1972) conducted a study of aitical reading and thinking skills of 
fifth and twelfth graders. They found that students with a strong language ability 
scored high on measures of critical thinking. 

In separate reviews of the literature Gray (1969) and Saadeh (1969) found that 
the ability to think critically can be taught effectively to people two years of age and 
older. Resnick would concur. 'The most important single message of this body of 
research is that complex thinking processes-elaborating the given material, making 
inferences beyond what is explicitly presented, building adequate representations, 
analyzing and constructing relationships-are involved in even the most apparently 
elementary mental activities. Children cannot understand what they read without 
making inferences and using information that goes beyond what is written in the text.... 
(Resnick, 1987, p. 45). 

The MAT total scale score in mathematics which was used as a predictor 
contributed an additional 9% to explained variance. As a measure of 'mathematics 
concepts, mathematics problem solving, and mathematics computation,' the subtest 
and TOPS would be expected to share some variance. 
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Whether the TOPS goes beyond the scope of tests of basic skills, like the MAT, 
to higher level thinking, critical reasoning, and more complex problem solving 
remains to be studied. The TOPS was developed to measure several process 
components, in a scientific context, which are most frequently associated with critical 
thinking, like the ones on Skinner's list: the ability to recognize a problem, formulate 
an hypothesis, test the hypothesis, gather data, analyze data, reject or accept the 
hypothesis, and draw conclusions (Skinner, 1976). However, evkJence for the validity 
of TOPS rests presently with content valklation, and to a certain extent with construct 
validation of predicted components. 

Future validity studies with TOPS should include the teacher ratings and scores 
from the intensive case studies of inoividuals with carefully developed protocols. This 
would constitute an intensive effort with a sample of 30 or niore if the individual 
assessments are included, however, the validation of an efficient, highly reliable 
measure of higher order skills such as TOPS would provide a model for the 
development of the 'standard-setting' tests which Wiggins (1989) has called for. If 
measurement-driven instruction is inevitable, then practicing for and taking the tests 
could enhance rather than impede education. 

Multiple Regression Analysis Using Selected Variables to Predict TOPS 

If students can be taught how to address TOPS-like problems more 
successfully, then analysis of the contribution of CRT-Mathematics scores to 
explained variance in TOPS scores might suggest a way to develop instruction. Of all 
the achievement measures available to the study, the CRT is the only one said to 
provide both a good fit to the actual curricular goals held by the school (unlike the MAT 
subtests), and a known basis for evaluation (unlike final grades). In the model of 
mastery learning with criterion referenced testing, teachers might be helped to target 
important and complex thinking processes and to guide students in practicing these 
strategies. If the CRT in mathematics includes some measures of critical thinking and 
problem solving, then indirectly at least, the benefits of the staff development strategy 
with teachers would be supported by the data. Assuming some of the teachers in the 
sample were already doing this, their students would score well on the CRT in 
mathematics as well as on TOPS. 
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TABLE 5.5 

Multiple Regression Analysis Specifying Order of Entry of Variatiles to Predict TOPS 



Predictor Variable b Beta T r2 after entry 



CRT-Mathematics 


.029 


.100 


2.28" 


.28 


MAT-Mathematics 


.040 


.262 


5.78*"* 


.36 


MAT-Reading 


.050 


.379 


11.73*"* 


.46 


Grade 6 


-.874 


-.072 


-2.35** 


.47a 


Grade 7 


.721 


.056 


1.84 




School 2 


-1.676 


-.124 


-3.70** 


.503 


School 3 


-1.588 


-.092 


-2.89** 




School 1 


-2.708 


-.223 


-6.32**** 





^Dunfvny variables for grade and school were entered as blocks. 

Constant: - -39.819 

R2-.497. p<.0OO1 (R».705) 

*p < .05 
**p<.01 
"*p < .001 
""p < .0001 
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Results of the multiple regression analysis predicting TOPS scores with forced 
order of entry of predictor variables are given in Table 5.5. The CRT in mathematics 
was entered first; it explained 28% of the variance in TOPS scores, as opposed to 37% 
when the MAT in reading was chosen first in the stepwise regression. The MAT in 
mathematics which was entered second explained an additional 8% over the CRT in 
mathematics. But the MAT in reading still explained an additional 10%, even when 
entered third. The factor of grade provided additional variance which was statistically 
significant but of little practical signiticance*-only 1^ The school factor which was 
entered last contributed an additional 3% to explained variance. Students were at a 
disadvantage not to be in School 4, th^ highest achieving school on TOPS (and 
overall.) 



Results of this multiple regression analysis with forced order of entry of 
variables are hardly conclusive, but they do suggest that direct instruction can make a 
difference in students* success in critical thinking and problem solving. In addition, 
the results cleariy endorse the importance of language, and not just mathematical 
reasoning, in higher order thinking. 



TOPS Sccres as Predictors of Final Graces 



A final strategy used to study the validity of TOPS was to see if TOPS scores 
might explain additional variance in student achievement, beyond what could already 
be accounted for by MAT-Reading and MAT-Mathemati'cs scores. Final grades were 
the oniy available measures of student achievement besides the test scores which had 
already been studied. Several regression analyses were run using final grades in 
reading, English, mathematics, saence and social studies separately as the criterion 
measure. In each case, the MAT reading and mathematics scores were forced into 
the equation first, then TOPS scores were added to see if TOPS could explain 
additional variance. 



The multiple R's for predicting final grades using both MAT scores were .36 for 
reading, .50 for English. .57 for mathematics, .39 for science, and .45 for social studies. 
When TOPS scores were entered in each of the equations, the muKipSa R*s did not 
increase more than one or two points. As a predictor of final grades, TOPS could add 
nothing to what the MAT scores already explained for those measures of achievement. 
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Si^mmary and Discussion 



Highly critical of the education being offered to students in middle grades in 
many of this country's schools, the Carnegie Council on Adolescent Development 
charged that: 'Nowhere is this failure more evident than in the development of 
American young adolescents' critical reasoning and higher order thinking." Under 
various labels, exhortations to teach for 'critical thinking,' 'higher order cognitive 
functioning/ and 'complex problem solving/ have been voiced for decades. What 
has changed dramatically is the way we gauge our society's productivity. No longer 
are we in an industrial age, t>ut rather an age of information technology, in which many 
people need to make a living by thinking, and not by rote assembly. Educational goals 
and objectives previously resen/ed for the elite are now being held for the masses. 

Fueling this renewed interest in teaching for higher order thinking skills is 'the 
single most important message of modern research on the nature of thinking' 
(Resnick, 1987, p. 8) that the kinds of processes traditionally associated with higher 
order thinking are not limited to advanced levels of development. In fact the term 
'higher order' skills is fundamentally misleading, t>ecause it suggests that lower order 
skills need to come first in a very linear fashion. The growing body of research in 
cognitive science on the acquisition of thinking skills particularly in reading, but also 
mathematics, attests to this finding. Long years of drill on the 'basics' before thinking 
and problem solving are required can no longer be justified. 

Yet, higher order thinking and critical reasoning are not being taught 
extensively, probably because teachers are unprepared to teach them well. Pervasive 
use of standardized tests of basic skills as the primary vehicle for accountability no 
doubt contributes to the problem. Despite the reason, the outcome is well 
documented; schoolchildren in this country do learn large amounts of infonnation, but 
they do less well on what are variously called the 'higher order skills' or the 
metacognitive skills-how to analyze, synthesize, and evaluate that information for their 
own use. 

Defining higher order cognitive fur)ctioning is the first problem which writers on 
the topic must address. Disciplinary perspectives often color their choice of terms; 
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philosophers promote logical thinking and critical reasoning; developmental 
psychologists point to metacognition; educators advocate teaching study skills and 
real life problem solving; cognitive scientists focus on cognitive strategies and 
heuristics for problem solving. Resnick's definition of Ngher order skills provides a 
fine complement to so many other definitions which emphasize the component 
processes. Her comprehensive, yet succinct, definition calls attention to the attributes 
of the problem situation arxj the reactions of the thinker as well. 

Higher order thinking involves a cluster of elabora^ve mental 
activities requiring nuanced judgement and analysis of complex 
situations according to multiple criteria. Higher order thinking is 
effortful and deperxis on self-regulation. The path of action or correct 
answers are not fully specified in advarce. The Oiir^er's task is to 
construct meaning arxJ impose structure on situations rather than to 
expect to find thwn already apparent{Resn\dk, 1987, p. 44). 

If the definition of higher order thinking is problematic, the measurement of 
higher order thinking is even more so. All 50 states use nationally normed 
standardized tests-of basic skills, but these tests emphasize recall of declarative or 
procedural knowledge, not the level or quality of student's thinking. Two compelling 
reasons for testing thinking are first, to determine how effectively thinking is being 
taught, and second, to ensure that it is. Several states have mandated both the 
teaching and testing of higher-order cognitive skills in their schools, but the mandate 
outstrips the availability of appropriate measuring devices if not knowledgeable 
practice as well. 

The present project undertook the challenge of developing an instrument to 
measure higher order thinking in the context of high interest, realistic problems 
requiring sdentific reasoning. The effort began with an existing instrument previously 
developed by the principal investigator with support from the National Science 
Foundation. The test was revised according to the recommendations made in the 
previous study (Shann, ^976); questions with poor item statistics were dropped; new 
items were created, but the general format context-dependent items centered around a 
realistic scenario was retained. In addition, the language was updated. Children's 
names and surnames were varied to reflect the predominantly black and Hispanic 
student enrollments in the sample schools of the present project. 
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The new test was named TOPS, or Test of Probiem Solving. It contained 31 
items on five scenarios: 'Pets In thb Classroom;' 'Bike Transportation;* 'The Window 
Sill Garden;' and 'A Busy Comer;' and 'A Classroom Temperature Chart.' Both 
Spanish and Vietnamese translations of TOPS were obtained. The test was 
administered during students' science periods; usabie returns were collected from 972 
students. 

Several technical aspects were studied to appraise the psychometric qualities of 
TOPS: item analysis, subtest analysis, reliability and validity. Item analysis included 
the determination of item difficulty and item discrimination levels, as wel! as item-total 
correlations using serial and point biserial methods. The difficulty levels represented 
a broad range, the easiest answered correctly by 91% of the students, and the most 
difficult answered conrectly by only 23%. Discrimination indices ranged from .17 to 
.68.; most were moderate or better, ranging from .50 and up. Each of the five subtests 
showed moderate to moderately high internal consistency reliability coefficients as 
determined by Cronbach's alpha. The values ranging from .50 to .67 are considered 
quite good for 6- and 7-items subtests. Reliabilit/ for the total test, as determined by 
Cronbach's alpha, was .84. 

Validity for the TOPS was established primarily through content analysis. 
Several opportunities were used to gather critiques of TOPS from graduate students in 
science and mathematics, from middle and secondary school teachers of these and 
other subjects, and from professors of education, psychology, and related disciplines. 
Construction validation was also addressed through the use of multiple regression 
analyses to study skill in problem solving in relation to reading comprehension, 
matt-iematics >x>ncepts, mathematics achievement, and grade level. The results deariy 
endorse the importance of language and not just mathematical reasoning in higher 
order thinking. 
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CHAPTER 6 



TEACHING BEHAVIORS WHICH PROMOTE HIGHER STUDENT ACHIEVEMENT 

The target of the present research has been school effectiveness and not 
teacher effectiveness. However, the study afforded the opportunlly to ask teachers 
at)Out the instructional practices they emp!oy in their classrooms. While a vast 
literature has emerged on effective teaching techniques, most of this knowledge base 
has been gained from studies of elementary, and to a lesser extent, secondary 
schools. Since lesser attention has been paid to middle schools, we decided to 
include in the teacher questionnaire a brief section on teaching practices which 
operate at the dassroom level. If tiie principal focus of ttie study had been teacher 
effectiveness, direct observation would have been used to document teaching 
practices, but this was beyond the scope of tiie present study and secondary to its 
main thrust 

Advances in research on school and teacher effectiveness started to come 
about when researchers abandoned atheoretical approaches typified by input-output 
studies of static variables in the school environment and began paying more careful 
attention to the dynamic processes which operate in schools and in classrooms. In 
addition, useful distinctions were made between schooi level variables such as 
management practices, staff development, scheduling, grouping, and reward systems, 
in conti-ast with classroom level behaviors such as how teachers organize and 
manage tiieir classrooms, how Vney design instruction, and what teaching practices 
they use for what purposes. Again, the latter are the focus of the present chapter. 

Evidence for Productive Teaching 

Effective schools start with effective teachers-tiiose who have a high sense of 
efficacy and responsibility for their teaching. They set high expectations for their 
students and hold students accountable for learning. The evidence for the 
effectiveness of these classroom level behaviors is even more striking for traditionally 
low achieving students. Within such businesslike, task-oriented environments where 
njles of conduct and academic procedure are deariy explained, effective teachers use 
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well organized, well prepared lessons which engage students in more time on task, 
especially in greater amounts of academic learning time, than those teachers who are 
less effective in improving student learning. Newmann (1987) argued that the most 
immediate and direct determinant of student achievement is student engagement, 
which in turn is most directly affected by the quality of interaction th£t students have 
with teachers. 

In his recent survey of research on instructional methods, Walberg (1990) noted 
that almost eight thousand field studies and surveys of teaching and learning have 
been reported in the past decade. He employed several useful distinctions in 
evaluating so vast a literature. First, acKn^. iedging the influence of psychological 
research on teaching, he cited the evidence tor the enormous effects of cues, 
engagement, corrective feedback and reinforcement on student learning. Then, he 
discussed methods and patterns of teaching that a single teacher can accomplish 
without unusual arrangements or equipment, or school level decisions. Walberg's 
review also addressed systems of instruction which require special planning, student 
grouping, materials, and equipment, as well as technk|ues whose effects are unique to 
particular subjects or types of students. 

In Walberg's classification, the psychological elements of cues, engagement, 
feedback and reinforcement undergird many effective teaching methods sudt\ as the 
use of advance organizers; pretesting; setting dear, high expectations; returning 
homework with comments; and sequencing instruction basBd on learning hierarchies. 
Patterns of teaching represent a more inclusive formulation which integrates the 
psychological elements and the methods of teaching. 

Patterns of Teaching Examined in the Present Study 

In the present study, a group of Likert-type items was framed to inquire about 
the indivklual teacher's frequency of use of various methods. Teachers offered self- 
reports on each of 16 instructional practices t>y drcling the appropriate number on a 
five-point scale from '1' equaling 'a lot,' to '5' equaling 'almost never.' These items 
are shown in Appendix B, Section 19, A through P of the Teacher Questionnaire. The 
items were reverse scored, so that higher numbers represented greater frequency of 
use. 
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Principal components factor analysis was applied to the 16 items to detennine If 
a smaller number of dusters of Instructional practices might bB used to represent 
pattenns of teaching, consistent with the usage adopted by Walberg. An established 
convention for the sample size required to use factor analysis is to have a number of 
respondents wliich is ten times the number of items u * the scale, or in this case. 1 60 
respondents. Since the useable database for this analysis numbered only 92 teacher 
questionnaires, it was particularly important to examine the distritxjtion of eigenvalues 
and percentages of variauwe explained by each factor. 

Results of this factor analysis are presented in Table 6. 1 . Included are the factor 
names, eigenvalues, percentages of explained variance, items loading .50 or more on 
each factor, and their weights. Five factors emorged with eigenvalues greater than 
1.0. Together they accounted for 66.0% of the explained variance. Despite the 
relatively small sample, the analysis wis judged to be appropriate on several ba.«es: 
the eigenvalues and percentages of explained variance remained at substantial levels 
after the first and later factors were extracted, i.e.. the values did not drop precipitously 
after the first factor: the factors were very 'clea.!* in that the items loaded on each 
factor with weights usually in excess of .60 or not at all. i.e.. dose to .00; and the high- 
weighted items formed logical, cohesive dusters. They were named as follows: 

1. Latxxatory/Demonstration 

2. Direct Teaching 

3. Field Trips/Class Projects 

4. Small Groups/Studen;: Led 

5. Woritbooks/lndividual Assignments 

Factor 1 . on the use of Laboratory/Demonstration techniques, emerged as a 
strong, dear first factor: but teachers who used these techniques were In the minority. 
!t could not be assumed that teachers did not kn^^w how to use these techniques, or 
that they were not disposed to using them, since laboratory facilities were virtually 
nonexistent in the sample schools. While a resourceful teacher could employ 
demonstrations, it wov'd have been all the more difficult to turn a conventional 
dassroom into a laboratory for a single dass period. 

The second factor, entitled 'DiiGct Teaching,' included items on 'teacher 
lecturing to the whole class.' and 'teacher leading discussion among whole class,' 



115 



TABLE 6.1 

Results ot Factor /^Jialysis of 16 Teaching Practices Setf-Reported According to Frequency of Use 



Factor Numt^er & Name Eigen- Pet of Cum Items on the Factor Weight 

value Var Pet 



: Laboratory/DerDonstration 


o./U 




OQ i 


U. 


TMcnar giving Odmonsiraiion wim equipmeni 


.09 










1. 


Students nriaasuring, collecting data 


.54 










V\. 


dajaenis wurKing in ibdoi aiories 














Students walking about the room 


.65 


. uifBCi 1 clacning 






w.wO 


A 


Teacher lecturing to the whole dass 


.83 


(Whole dass lecture/discussion) 








B. 


Teacher leading discussion among whole class 


.81 








M. 


students woi king all or the same lesson 


.71 


1: Field Trips/Class Projects 


1.72 


10.7 


49.5 


J. 


students creatlrtg things 


.63 








L. 


Students taking super^sed field trips 


.75 










0. 


Whole class working together 


.54 










P. 


Students working on a project of their choice 


.71 


k Small Groups/Student Led 


1.46 


9.1 


58.6 


C. 


Teacher visiting smaH groups within the class 


.74 


(Teacher visiting groups) 








E. 


Studenta giving presentations to the class 


.50 








F. 


Students discussing problems In small groups 


.73 


K Workbooks/Individual Assignments 


1.18 


7.4 


66.0 


G. 


Students writing papers, stories, assignments 


.68 








H. 


Students filling in workbooks or exercise sheets .73 










1. 


Students measuring, collecting data 


.56 
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which were weighted .83 and .81 respectively. Walt>erg termed this pattern 'explidt 
teaching,' which he noted was 'traditional or conventional whole-group teaching done 
well.' Others have called it 'process-product teaching.' 'active teaching,' or 'effective 
teaching* (Gage, 1984; Medley, 1983; Good iBrophy, 1985; Shulman,1986). Under 
any of these names, direct teadiing includes rapid presentation of new content in 
small steps, guided student practice with dose monitoring by the teacher, and regular 
review with corrective feedback and instructional reinforcement. 

The nerf three factors emphasize student leaming activities which are fostered 
by the teacher. The first of these is Factor 3 on the use of 'Field Trips/Class Projects,' 
in which students create things, working ort a project-centered activity, but the work is 
not done in isolation: rattier it may involve the whole class, and it is supen/ised. The 
items loading on Factor 4. entitied 'Small Groups/Student Led.' emphasize activities 
in which students work in smaller groups, but again ttie activities entail responsibility to 
others for discussion and presentation of information, as well as supervision by the 
teacher. Both of ttiese factors. 3 and 4, are quaiitati'vely different from Fador 5, on use 
of 'Workbooks/Individual Assignments' ttie latter induding student activities which 
involve no interaction wrtti otiier students or ttie teacher; ttiey are done independentiy, 
in intellectual, if not physical, isolation from others. 

Factor scores were created by adding teachers' responses on the items 
contaibuting to each of the five factors. The resulting fador scores were used as the 
dependent variables in subsequent analyses of variance to investigate what 
differences in teaching patterns con-esponded to differences in student achievement. 

Teaching Patterns in Relation to Student Achievement 

Since effective teaching is at tiie core of effedive schooling, attempts were 
made in the present study of school effectiveness to assodate differences in student 
achievement with ttie paitems of insti^Ictional behaviors which teachers reportedly use 
in their dassrooms. In the four schools constituting our sample, the vast majority of 
students had different teachers for different subjeds. We were unable to match 
students and ttieir teachers directiy, since we colleded the teacher questionnaires 
coded only by school in an effort to guarantee anonymity and promote a higher retum 
rate. Identification of teachers by which grades and subjects they taught was based 
on their responses to items in the questionnaire. 
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Analyses of variance had established that significant differences existed in 
student achievement data by grade, and by school, for each of following test 
measures: Metropolitan Achievement Tests (MAT) in Reading and in Mathematics: 
Criterion Referenced Test (CRT) in Mathematics: and the Test of Problem Solving 
(TOPS). Interaction effects were also significant for each of these measures. 

In an effort to investigate whether the teachers of students in the higher 
achieving schools employed different teaching patterns, we sought to distinguish 
among the overall significant main effect for school differences, which school means 
were significantly different from which other school means. (This had to be done 
separately by grade level, since c :hool by grade interaction effects were significant. 
Graphs showing these interaction effects are reproduced in Figures 6.1 through 6.4.) 
Duncan multiple range tests were used to confirm which pairs of mean differences 
were significant, and the schools were regrouped accordingly. Thus, for example, the 
F ratio for school differences in MAT-Reading scores was highly significant (F-8.00, 
df»3. p<.0(X)1), but this overall difference could be attributed to the difference between 
the mean for School 2 and those for Schools 1 , 3, and 4. For subsequent analysis of 
the teaching patterns, the teachers were compared in two groups, those in School 2 
versus those in Schools 1, 3, and 4. 

Not all of the teachers in each school were used in the analyses, only those 
who reported teaching the subject(s) related to the test at the grade levels where 
school differences occun-ed. For each test content area, these teachers who taught 
the given sut)ject at the grade level in question were pulled from the larger teacher 
data base for the analysis of differences in teaching patterns which might con-espond 
to the mean differences in ' Hjdent achievement scores for that subject at that grade 
level. Teachers were grouped by schools in the sarr.") combinations which the student 
achievement data analysis supported, and analyses of variance by school groups 
were conducted using each of the five teaching factors as dependent variables. Thus, 
when school differences in student achievement data were significant at a given grade 
level, teachers were sorted into corresponding groups according to school differences 
within grade, and their reported teaching practices served as dependent variablei> in 
ttie ana-ysis of variance of differences by school. 
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Teaching Patterns Associate d with Higher MAT Reading Scores 



As reflected in Figure 6.1 and confirmed by a Duncan test, sixth-grade students 
at School 2 averaged significantly higher in the MAT-Reading test than sixtJ-grade 
students at the other three schools. The average frequency of use of various teaching 
patterns among teachers grouped t>y school to correspond to significant differences in 
student achievement on the I^T-Reading are presenied in Table 6.2. When sixth 
grade reading teachers in Sch»D0l 2 were compared to their counterparts in Schools 1, 
3, and 4, the former reported significantly more frequent use of student led. small 
group discussion as well as supervised projects involving the whole dass. At the 
seventh grade level, students in Schools 3 and 4 averaged significantly higher in 
MAT-Reading scores than students in Schools 1 and 2, but no significant differences 
in the te;*ching patterns could be found among seventh-grade reading teachers in 
Schools 1 and 2, versus 3 and 4. However, al the eighth-grade level, students in 
School 4 scored significantly higher on the MAT-Reading than did students in Schools 
1 and 2. Correspondingly, eighth-grade reading teachers in Scnool 4 reported 
significantly more frequent use of student led, small group discussion than those in 
Schools 1 and 2. 

Teaching Patterns Associated with Hioher MAT M athematics Scores 

Duncan tests of the significance of differences in sixth graders' MAT- 
Mathematics scores among schools showed that students in Schools 4 and 2 scored 
significantly higher on average than students in School 1, who, in tum, scored 
significantly higher than students in School 3. The average ft-equency of use of 
various teaching patterns among teachers grouped by school to correspond to 
significant differences in student achievement on the MAT-Mathematics are presented 
in Table 6.3. Analysis of variance of the instructional patterns reported by teachers 
grouped in Schools 4 and 2, versus School 1, versus School 3, produced significant 
differences in the extent to which their students filled in wori<books and exercise 
sheets and did individual assignments in dass. Teachers whose students averaged 
highest on the MAT-Mathematics had their students using wort<books much less 
fi-equentiy than students in the middle and, in tum, lowest achieving schools. 
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Analyses of school differences In MAT-Mattiematics scores among seventh 
graders revealed that students showed progressively higher rates of achievement In 
School 3, versus Schools 1 and 2, versus School 4. When factor scoras for teaching 
behaviors were sorted Into these three groups of schools and subjected to analysis of 
variance, it was found that teachers in the highest achieving school, School 4, said 
they used significantly more direct teaching, including lecture and discussion with the 
whole dass, vA\\\b teachers in the lowest achieving school. School 3, reported having 
their students spend more dass time filling in workbooks, exerdse sheets, or other 
individual assignments. 

At the eighth-grade level, students in School 1 scored significantly lower on the 
MAT-Mathematics than students in Schools 2, 3, and 4. Analysis of diffetences in 
teaching patterns among teachers sorted according to this grouping of schools 
showed that teachers in School 1 reported signifteantly less frequent use of student 
led, small group work than teachers in Schools 2, 3, and 4. 

Teaching Patterns Assadated with H igher CRT Mathematics Scores 

The average frequency of use of various teaching patterns among teachers 
grouped according to school differences in student achievement on the CRT- 
Mathematics are presented in Table 6.4. Analysis of school differences in CRT- 
Mathematics scores at the sixth grade level produced significant differences fcdtween 
School 1 versus Schools 2, 4, and 3. However, analysis of differences in teaching 
patterns among teachers grouped in this way produced no significant differences. 

At the seventh-grade level, students in Schools 3 and 4 outperformed stuae -its 
in Schools 1 and 2 by a significant margin. Analysis of the teaching patterns reported 
by the teachers in Schools 3 and 4 versus 1 and 2 revealed that teachers in the higher 
achieving schools, 3 and 4, employ direct teaching to a significantly greater extent 
than seventh-grade mathematics teachers in the lower achieving schools. 
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TABLE 6.2 

Significant Differences in TeacNng Practices in Relation to Student Achievement on the MAT-Reading 



Grade Level 


Factor Scores Showing 
Significant Differences 
In Teaching Practices 


Means for Frequency of Teaching Practices 

And Numl)er of Teachers Reporting in 
Schools Grouped by Student Achievement 

Low er AcNeving Schools / Higher Ac'Jeving Schools 


F 


Oul yiauo 




'kiioolsl.3. 4 


VS. School 2 






3: Field Trips/Class Projects 


10.42 
(n-24) 


13.25 
(n-8) 


F=5.66 
p< .02 




4: Student Led/Small Groups 


7.70 
(iv27) 


10.13 
(rr6) 


F»4.64 
p< .04 


/ih grade 


No Significant Differences 


Schools 1,2 


vs. Schools 3, 4 




oth grade 




School 1 


vs. Schools 2: 4 






4: Student Led/Small Groups 


7.00 
ln-5) 

School3 


9.75 
(n-12) 

vs. School 4 


F=4.16 
p< .05 




5: '.Vorkbooks/lndividual 
Assignments 


9.11 

(n-9) 


6.17 

(n-6) 


r=3.28 
p< .09 
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TABLE 6.3 



Significant Differences in Teaching Practices in Relation to Student Achievement on the MAT-Mathematics 



Grade Level 


Factor Scores Showing 
Significant Differences 
In Teaching Practices 


Means for Frequency of Teaching Practices 
And Numk>er of Teachers Reporting in 
Schools Grouped by Student Achievement 

Low er Achieving Schools / Higher Achieving Schools 


F 


6th grade 




School 3 vs 


School 1 vs Schools 2.4 






5: Workbooks/Individual 
Assignments 


8.44 
Irrt) 


7.14 5.75 
ln-7) ln-12) 


F=3.15 
p< .06 


7th grade 




School 3 vs. 


Schools 1.2 vs. School 4 






2: Direct Teaching 


7.17 


5.90 9.43 
ln-10) ln-7) 


F=4.10 
p< .03 




5: Worktxx)ks/lndividual 
Assignments 


10.20 
<n-5) 


6.67 6.67 
ln-9) (n-6) 


F=3.06 
p<.07 


8th grade 




School 1 


VS. Schools 2, 4 






4: Student Led/Small Groups 


6.20 
ln-5) 


9.12 
^n-17) 


F=5.04 
p< .03 
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TABLE 6.4 

Significant Differences In Teaching Practices in Relation to Student Achievement on the CRT-Mathematics 



Grade Level 


Factor Scores Showing 
Significant Differences 
In Teaching Practices 


Means for Frequency of Teaching Practices 
And NumDer or i eachers neponing in 
Schools Grouped by Student Achievement 


p 
r 


6th grade 


No Significant Difference 


School 1 vs. Schools 2,3,4 




7th grade 




Schools 1,3 vs. Schools 3,4 






2: Direct Teaching 


5.90 8.38 
(n-10) (n-13) 


F=5.16 
p<.03 


8th grade 




School 1 vs. School 2 vs. School 4 vs. School 3 






2: Direct TBacning 


C OA R C7 Q flfl 7 17 
O.oU O.D/ 9.00 l.ll 

ln-5) (n-3) (n-6) (n-8) 


r 1 
p<.04 




5: Workbooks/Individual 
Assignments 


7.50 5.00 6.17 10.40 
(n-4) (n-3) (n-7) (n-5) 


F-2.96 
p<.06 
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Sdiool-to-school differences in CRT-Mathematics scores at the eighth-grade 
level were significant across the tx>ard, i.e., School 1 scored significantly lower than 
School 2, which scored significantly lower th&n School 4, which in turn scored 
significantly lower than School 3. The coaesponding analysis of teaching patterns 
showed that teachers in Schools 1 and 2, the lower achieving schools, reported 
significantly less frequent use of direct teaching. 

Teaching Patterns Associated wi th Hi(?her Scores on TOPS 

As reported earlier, the number of students who were tested with the new Test 
of Problem Solving varied considerably in each of the four schools. The return rates 
for students in School 2 and 3 were considered too low to be represeriiative (23% and 
35% respectively), so the analysis of school differences was limited to TOPS scores 
for students from Schools 1 and 4, whose return rates were 67% and 66% of the full 
time equivalent students which those schools are said to enroll over the academic 
year. The two-way, school by grade analysis of variance revealed highly significant 
differences favoring achievement of students in School 4 over students in School 1 
(F-71.98, p<.0001) at all three grade levels. Unlike the analyses of the other 
achievement test scores, the ANOVA with TOPS produced no significant interaction 
effect. These results were portrayed graphically in Figure 4.4. 

Significant differences were also found in the instructional patterns reported by 
teachers of mathemaficf; and science in School 1 versus School 4. (Since the TOPS 
addresses skills for problem solving in the context of science and mathematics, 
teachers of both subject areas at all grade levels were pulled from the larger sample 
of teachers in School 1 and 4 for the analysis of reported teaching practices.) The 
teachers in the higher achieving School 4 reported significantly more frequent use of 
direct teaching as well as student led, small group work than their counterparts in 
School 1 . The average frequency of use of various teaching patterns among teachers 
in School 1 versus School 4 vt/hich corespond to significant differences in student 
achievement on the TOPS are presented in Table 6.5. 



124 



TABLE 6.5 

Significant Differences in Teaching Practices in Relation to Student Achievement on the Test of Problem Solving 



Grade Level Factor Scores Showing 
Significant Differences 
In TeacNng Practices 



AH Grades* 



^4 for Frequency of Teaching Practices 
HTKl Number of Teachers Reporting in 
Sck^ As Low versus High In Student Achievement 



Low 



High 



Schodl 



vs. 



School2 



2: Direct Teaching 



6.40 

ln-10) 



9.18 
Ml) 



F-5.58 
p<.a3 



4: Student Led/Small Groups 



7.20 
lf*-10) 



10.18 
(n-11) 



F-5.00 
p<.04 



•Since the School X Grade ANOVA of TOPS scores for students in Schools 1 and 4 produced no significant 
interaction effects, the same patterns of significant differences between schools in student achievement on TOPS 
existed for all three grade levels, 6, 7, and 8. 
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Summary and Discussion 

The major thrust of the present study has been to create and validate indicators 
which can be used to monitor the process of school refomfi and to gauge whether 
schools are l)ecoming more effective in various ways. In all of this, school level rather 
than classroom level variables have been more salient for studying how the norms 
and culture of the school influence the behavior of its participants. Nonetheless, 
effective teaching is at the core of effective schooling. While the researchers could not 
engage the study of teaching through sustained, direct observation, the team decided 
to include items of the teacher questionnaire which requested self-reports of the 
frequency of use of a variety of instructional practices. Teachers responded on a scale 
of one to five, and theii scores were transfomned so that a 'one' indicated 'almost 
never.' and a 'five' reflected 'a lot.' 

Factor analysis of the responses to the 16 items, as reported by 92 teachers, 
produced five significant factors with exceptionally clear results and clean loading. 
The five dusters accounted for 66.0% of the variance in the original data, and the 
majority of items loaded on only one of the five factors with weights in excess of .70. 
Factor scores were created by adding those items which weig!ited .50 or higher on 
each factor. The five teaching patterns were named as follows: Use of (1) 
Laboratory/Demonstration; (2) Direct Teaching (lecture and discussion with the 
whole dtiss); (3) Field Trips/Class Projects: (4) Small Groups/Student Led; and (5) 
Workbooks/Individual Assignments. 

These fador scores were used as dependent variables in the analysis of 
variance of teaching patterns by school. Instead of examining differences among all 
four schools a priori, post hoc designs were used in which the teachers were grouped 
by school according to the results of Duncan tests of the significance of mean 
differences in student achievement among schods, within grade level. Depending 
on vk^ere significant differences existed among groups of schods on the measures of 
student achievement, teachers of those sutsjects at each grade level were sorted into 
the same groupings of schools for the analysis of variance of teaching fador scores. 
A summary of the evidence for effective teaching practices can be found in Table 6.6. 
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Factor 1 , on the use of Laboratoiv/Demonstration techniques, emerged as a 
strong, dear first factor; but teachers who used these techniques were in the minority 
The factor was not significant in the analysis of any school differences in teaching 
patterns. However, it is important to note that the physical facilities, material resources, 
and dass schedules which the teachers in the sample had to work with precluded all 
txit heroic efforts to use latx)ratory arxi demonstration methods in their teaching on 
any regular t)asis. 

The limited use of lak>oratory and demonstration techniques by science and 
mathematics teachers should be cause for concern. The American Assodation for the 
Advancement of Science (1989) in its landmark report. Science for All Americans, 
urges teachers to employ well-tested practices for effective teaching of science, 
mathematics and technology, chief among them, engaging students in active inquiry 
and investigation. Teachers should foster varied opportunities for interviewing, 
surveying, and observing behavior as well as using hand lenses, microscopes, 
thermometers, cameras, and other common instruments. In addition, the National 
Science Foundation has sponsored many studies of student inquiry which show that 
giving students opportunities to design experiments arxj manipulate science materials 
fosters positive effects of both a cognitive and affective nature regarding sdence (e.g., 
Shann, 197T'). 

■^he second factor, entitied 'Direct Teaching," included items on "teacher 
lecturing to ttie whole class,' and 'teacher leading discussion among whole class," 
which were weighted .83 and .81 respectively. It is ti'aditional, or conventional whole- 
group teaching done well. Practices associated with direct teaching include rapid 
presentati^-n of new content in small steps, guided student practice with close 
monitoring by the teacher, and regular review with corrective feedback and 
instructional reinforcement. This factor differentiated the teachers of seventh grade 
students who were more successful than their counterparts in other schools on three 
of the four test measures: MAT-Mathematics, CRT-Mathematics, and TOPS, whose 
items reflect botii science and mathematics contexts. Direct teaching was also 
associated with higher student TOPS scores at the sixth and eighth grade levels. 
Teachers of tiie higher achieving students reportedly used direct teaching practices 
more frequentiy than teachers of lower achieving students. 
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TABLE 6.6 



Summary of Evidence for Effective Teaching Practices in Relation to 
Significant Differences in Student AcNevement Data By School 



Student AcNevement As 
Measured By: 



Whose Teachers Use: 



With What Results 



Level of p* 



MAT- Reading scores for: 
6th gradB classes 

8th grade classes 



MAT-Mathematics scores for: 
6th grade classes 

7th grade classes 
8th grade classes 



Class Projects/Field Trps 
Student Led/Small Groups 

Student Led/Small Groups 

Workkx>oks and Individual 
Assignments 



Workt)ooks and Individual 
Assignments 

Direct Teaching 

Workt)Ooks and Individual 
Assignments 

Student Led/Small Groups 



are significantly higher 
are significantly Ngher 

are significantly higher 
are significantly lower 



are significantly lower 

are significantly Ngher 
are significantly lower 

are significantly higher 



p < .02 
p< .04 

p < .05 
p < .09 



p < .06 

p < .0^ 
^ < .07 

p < .03 
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TABLE 6.6(cor!t.) 



Student AcNevement As Whose Teachers Use: With What Results Level of p* 

Measured By: 



CRT-Mathematics 
7th grade classes 
8th grade classes 



TOPS 

All grade levels 



Direct Teaching 

Direct Teaching 

Workkx)oks and Individual 
Assignments 

Direct Teaching 

Student Led/Small Groups 



are significantly higher 
are significantly Ngher 
are significantly lower 



are significantly Ngher 
are significantly higher 



p < .03 
p < .04 
p < .06 

p < .03 
p < .04 



'Differences significant at p < .09 or t>eyond are reported t>ecause the n's (number of teachers) for these 
comparisons were very small, and the resulting degrees of freedom very low. 
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Factor 3 on the use of Field Trips/Class Projects differentiated between teachers 
of high versus lower achieving sixth grade students as determined by their scores on 
the MAT-Reading. Teachers of students in the higher scoring school reported more 
frequent use of supervised trips and project-centered, whole dass activity. 

The fourth factor, entitled 'Student Led/Small Groups' represented a teaching 
pattern v^ich was associated with higher student achievement at both the sixth and 
the eighth grade levels on the MAT-Reading and at all three grade levels on TOPS. 
In addition it differentiated teachers of higher versus lower achieving eighth graders on 
the MAT -Mathematics. Teachers who reported more frequent use of 'Small 
Groups/Student Led' supposedly fostered activities in which students took 
responsibility for presentation snd discussion of ideas among each other while the 
teacher visited the groups, fhis teaching pattern was associated with higher levels of 
student achievement in five of ten comparisons. 

The final factor which emerged from factor analysis of self-reported teaching 
behaviors was the use of 'WorkbooKS/'inuividual Assignments.' This factor was 
associated with differences in student achievement in four out of ten possible 
comparisons, but in three out of four of these significant findings, students who had 
more dass time spent on workbook and individual assignments had significantly lower 
scores than their counterparts whose teachers did not use this pattern so frequently. 
The one exception in which more frequent use of workbooks and individual 
assignments favored the highest achieving school was found for eighth graders from 
School 3 scoring highest on the CRT-Mathematics, whose teachers were known to 
spend considerable time teaching for the test with practice on examination items. 

Sixth grade and seventh grade students who performed less well on the MAT- 
Mathematics, and eighth grade students who scored significantly lower on the MAT- 
Reading all had teachers in those sut)jed areas who reported more frequent use of 
workkx>oks and individual assignments than higher achieving students, whose 
teachers used significantly less of this pattern of teaching. Eighth grade students 
showed mixed results on the CRT-Mathematics in relation to their teachers' reported 
use of workkx>oks and individual assignments; it appeared that corresponding 
emphasis on direct teaching in conjunction with practice in workbooks n / have 
produced the superior results for classes at one school, but over reliance on 
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workbooks without coiresponding use of direct teaching was associated with the 
poorest performance on the CRT-Mathematics. 

If these striking results are indeed valid, teachers should be advised to limit 
students' use of workbooks and individual assignments during class time. Instesu 
they should use teaching patterns which promote higher student engager.ent, 
particulariy the kinds of activities suggested by Factor 4, which are reflected in 
cooperative learning. Workbook exercises and indivkJual assignments allow students 
to look like they are busy at wori<,when in fact they may not be. These assignments 
may be useful for some purposes as homework assignments. Even then, students 
should receive written comments on what they do (Walberg, 1990). 

The analysis of teaching patterns associated with higher levels of student 
achievement was accomplished indire* tly. After school differences in student 
performance on each of four achievement tests were observed to be significant at 
every grade level, Duncan tests were used to specify which school means were 
different from other school means. Sorting teachers into the same clusters of schools 
which differentiated sti'dents according to the achievement data, we conducted 
analysis of their teaching patterns as measured by the factor scores of self-reported 
teaching practices. 

Methodological purists would caution that aggregation effects may account for 
any association between differences in student achievement and differences in 
teaching patterns, on the argument that higher achieving students and better qualified 
teachers would assemble at the same schools, more often those in advantaged 
suburbs than those in disadvantaged urban areas. While this may be a valid criticism 
of studies which suggest causal links between higher student achievement and higher 
teacher qualifications (Weaver, 1986), it is not a valid argument for the present study. 
Two-thirds of the teachers reported earning advanced degrees, suggesting that there 
is littie variat)ility in their achievement levels, and all were teaching students who came 
from disadvantaged urban communities. However, if the use of actual teaching 
behnviors does correlate with student achievement, the finding has important 
implications for teacher ti-aining, staff development and dassroom practice. 

The inquiry about classroom teaching practices was secondary to the main 
thrust of the study; the measures were self-reports, and the design was weak; it did not 
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make strong connections between student achievement and actual classroom 
teaching practices of those students' teachers. Still, strong, dear factors emerged 
which distinguished teaching patterns used by more effective versus less effective 
teachers, as determined by student achievement. 

Given that Factor 1 included Laboratory/Demonstration activities which could 
not be used realistically in the schools, differences in the remaining four teaching 
patterns were being compared, paralleling significant differences among schools on 
^ree achievement tests, at each of three grade levels, making 36 possible differences. 
Since analysis with the fourth measure of student achievement (TOPS) produced no 
significant schoolXgrade interaction effect, differences in the four teaching patterns 
were not qualified by grade. In all then, there were 40 possible differences (36 4) 
which might have been found in the analyses of teaching behaviors, and 13 were 
found to be significant at approximately the .05 level or beyond. Fully one-third were 
statistically significant, whereas only about 5%--fewer than three-would have have 
been significant by charge alone. 

TnwtB findings on teacher effectiveness suggest important choices for staff 
development, scheduling, and coaching-all of which are school level, rather than 
classroom level decisions, with immediate implications for strategies for school 
improvement. 
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CHAPTER 7 



THE STUDENTS AND WHAT THEY VALUE 



Increasingly, schools are being urged to undertake moral education and 
character development as complements to academic learning (Wynne & Walberg, 
1986). Some would argue that education and schooling are intrinsically moral 
enterprises; the school's role in the teaching of values and the shaping of character 
isn't new-it comes with the temtory (Ryan, 1':86). Others, not necessarily in 
disagreement, point to the growing reliance on schools as social institutions to do 
more of what families and other units in contemporary societies are doing less and 
less. Still others, like Bereiter (1973). argue that the teaching of values is an 
inappropriate role for schools in a pluralistic society. 

Cause for Concern 

Coleman (1987) contends that families at all economic levels are becoming 
increasingly ill-equipped to provide the social capital that schools are designed to 
complement and augment in educating our new generations. Offering historical and 
economic perspectives on changes in the structure of family life, Coleman argues that 
there has been a decline in the capability of the household to be the principal welfare 
institution in society. What is meant by social capital in the raising of children is the 
norms, social networks, and the relationships between adults and children that help 
children grow up in positive, functional ways. Social capital exists within th<^ family, 
but also outside-in the community, churches, and especially schools, which are 
increasingly important for those children without extensive social capital within the 
home. Drawing similar conclusions, other noteworthy analysts have pointed to the 
school as the conduit for an increasingly wide range of socialization activities and the 
delivery of a host of human services (Carnegie Council on Adolescent Development. 
1989). 

Newmann. Director of the National Center on Effective Secondary Schools 
(1990) argues that increasing numbers of secondary school students (largely poor, 
urban, minority, and those from families in crisis) do not try to succeed in school. They 
have lost hope because they see no social or economic benefits of success in school, 
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or, burdened by family and interpersonal stress (from physical abu^e, substance 
abuse, divorce and many other sources) they have little time or energy for schoolwork. 
Newmann asks how can hope be rekindled in ttx)se who have lost it. or generated in 
those who have never experienced it. He calls hope the psychological capital on 
which human and social capital depends. 

The Stereotypes 

The extent of this hopelessness and especially its onset, are important to 
determine. Fueled by the media, stereotypes abound of black and other minority youth 
more interested in gold chains, fancy cars, fine clothes arxj other trappings that 
dealing in drugs can make affordable. That wealth can buy happiness is a myth for all 
age groups. That youth from minority family backgrounds have lesser regard for 
traditional values and the importance of good education is also wklely heki. The peer 
group is thought to be especially important for youths in early adolescence. Data from 
the present study would dispel most of these stereotypes for these middle school 
students. There is cause for alarm, but it is not epkjemic, even among this sample of 
economically disadvantaged, minority students, at least not yet. 

The Good News 

Data from the questionnaire administered to almost 1600 students enrolled in 
four Boston inner city middle schools indicate that these students still subscribe to a 
very traditional value system which prizes family, good education and hard work. 
More than 96% think that it is important to go to school. They are there primarily 'to 
learn" (93%), 'to get a good job in the future" (74%), and 'to get into college" (70%). 
Fewer than 21% say they go primarily "to see their friends," "because their parents 
make them' (10%), or "for something to do' (4%). (See Appendix B, responses to 
items 7 and 9 on the student questionnaire.) 

Several items on the questionnaire were designed to inquire about the 
students' values. In particular, students were asked to rate the importance of ten items 
on a scale of 1 to 5. (See Appendix B, Section #35, Items A through J.) The 
percentage distributions of responses are given in Table 7.1. As noted in an earlier 
chapter, fewer than 9% of the students in these schools were white; most wbre 
Hispanic (36%), black (33%), Asian (13%), or some combination. Almost all would be 
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Table 7.1 

Student Ratings on the Importance of Ten Values 





noi 

impoftHTt 




vnponan 




WHV 

W J 

important 




1 


2 


3 


4 


5 


A.Fan«y 


A% 




Z7% 


4.3% 


92.1% 


B. Being rich 


24.5% 


11.4% 


35.2% 


10.6% 


18.2% 


C. Friends 


3.6% 


4.9% 


26.8% 


22.4% 


42.2% 


0. Future education 


SPh 


1.6% 


5.3% 


8.8% 


83.4% 


EHiMnglUn 


8.4% 


99% 


33.1% 


21.2% 


27.4% 


F. Getting good grades 


.7% 


JBPfo 


5.1% 


14.9% 


78.7% 


G. Feeling safi 


1.7% 


23% 


9.1% 


18.5% 


68.4% 


H. Helping others 


32% 


62% 


27.4% 


28.4% 


34.7% 


1. Hewing a job noNtf 


12.8% 


8.9% 


24.5% 


17.5% 


36.3% 


J. Future job 


1.1% 




5.1% 


9.7% 


83.4% 



regarded as economically disadvantaged, txjt the value system they report '-oks very 
much like that of conventional 'middle America,' a finding which surprises white 
middle dass adults txjt affirms what the t)lack, Hispanic, and other minority educators 
in their midst already know. 

More than 92% of the students rated 'family' in the highest category. Highest 
ratings were also given to 'future education' (83%) and 'future job' (83%), and to 
'getting good grades' (79%). As seen in Table 4.1 , the distribution for each of these 
values is highly skewed, with the vast majority of responses piling up on the high end 
of the scale. 'Feeling safe' was also very important to the students, as indteated by the 
high percentages (18% and 68%) choosing categories 4 and 5 respectively on that 
item. 
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The distribution of responses on the importance of 'friends' was also weighted 
toward the high end of the scale, but the skew was not nearly so pronounced. Only 
42% of the students chose the highest scale point for 'friends,' a surprisingly low figure 
to most who know the supposed importance of the peer group to this age level. 
Ratings assigned to 'helping others' resembled the more moderately skewed 
distribution for the importance of friends. However, the distribution of ratings flattened 
out across the scale for the nrore hedonistic values of 'beina rich,' arxl 'having fun.' 
Mot only do these middle school students care a great deal about their families, they 
view education as the key to improving their own futures. Having fun and being rich 
are of much lesser importance. 

Dispelling a Myth 

Adolescence in American society has long been dcocribed as a period of 
rebellion against parental norms and rejection^ of traditional attitudes and values. 
More than a quarter of a century ago, Bandura (1964) characterized the myth this way: 

The adolescent presumedly Is engaged In a struggle to 
emancipate himself from his parents. He therefore resists any 
dependence upon them for their guidance, approval or company, 
and rebels against any restrictions and controls tt.at they Impose 
upon his behavior. To facilitate the process of emancipation, he 
transfers his dependency to the peer group whose values are 
typically In conflict with those of his parents. 

Bandura and Walters (1959) and other social scientists felt the need to 
challenge this myth and to note the detrimental consequences resulting from the 
persistence of the myth. Beater, Wiliits and Maida (1964) summarized a large body of 
research findings which did not support the rebellion '*mage as the characteristic or 
most widespread pattern of adolescent behavior. Then as now, adolescents chose 
family as far more important than school friends as the important reference point in 
their lives. This was true for rural as well as urisan youth, and for teenagers from both 
lower and upper income families. 
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Researchers at the Cente. for Early Adolescence cite more recent studies of 
normal adolescents and their families which also show that the social and emotional 
problems generally associated with adolescents and the rejf stion and rebellion 
against the values or beliefs of their parents have been grea iy overemphasized 
(Dorman & Lipsitz, 1984). While they acknowledge the inaeas? ig importance of the 
peer group as the most notable social change for early adolescence, Dorman and 
Lipsitz explain that adolescents themselves report looking to the peer group for 
association and companionship, and to their families for affection, identification, 
values, and help in solving larger problems. 

Other Indicators of Values 

Item 16 on the questionnaire was designed to inquire about parental regard for 
the value of education from, the student's perspective. Almost 93% of the students 
reported that their parents (or guardians) think that school is 'very important;' 6.7% 
answered "important,* and only .5% replied 'not important' or did not respond. To 
gauge ihe relative importance of parents and other adults in their lives, students were 
asked in item 19 to 'Check the three most important adults in your life.' Fully 97% 
choose 'mother* but the figure dropped to 83.5% for 'father'. 'Other relatives' were 
chosen among the top three by 56% of the students, 'a teacher' by 15%, 'a coach" by 
3%, and "other* by 15.2%. These resi;lts underscore once again the importance of 
family to young adolescents, but the discepancy in the rates choosing mother versus 
father suggest the absence of the father and his lesser influence in female headed 
households. The data from the student questionnaire do not enable us to tell whether 
fathers or stepfathers are actually present in the home, but it is important to note that 
the father, absent or not from the residence, is still reported by the early adolescent tc 
be an important adult in his or her life. 

Additional items which are related to students' values are also included in the 
questionn^^ire, however, the items are so numerous, they are presented in separate 
chapters. Responses to items from sections 11, 12, and 13, regardinp how students 
spend their time after school, on weekends, ano during the summer, as well as item 
15 on participation in volunteer work are presented in Chapter 8. How students 
spend their time outside of school sugges*^ what interests them but may also be 
indicative of what the students value and what factors shape their values. 
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The frequency of prosocial and antisocial laehaviors i the school may be 
reflective of the students' collective values, as manifest in their daily environment. 
Responses to items on these behaviors from sections 36, 37, and 38 of the Student 
Questionnaire are reported in Chapter 9. Indices on rewards and punishments for 
individuals and groups are also reported in Chapter 9. 

Differences in Values by Gender. Race, Grade, and School 

Student responses to the ten items in section 35 of the questionnaire were 
analyzed using Chi Squares and cross tabulations to determine if the distributions of 
responses were different according to the student's gender, race/ethnidty, grade, or 
school. Results of these analyses are summarized in Tat)le 7.2. It is insbuctive to note 
that no significant differences in importance of family were found on any of the 
demographic factors. Such a high percentage of the students rated the importance of 
family so highly that no differentiation could be noted. 

Differences by Gender 

Statistically rJgnificant differences in item responses according to gender are 
indicated by several of the 's reported in the first column of figures in Table 7.2. 
The males were far more interested in being rich and having a job now. The females 
were somewhat more interested in future education and getting good grades, and 
especially more interested in feeling safe and in helping others. 

Differences r-^ace 

Probability values given for the X' s reported in the second column of figures in 
Table 4.2 indicate that significant differences by race/ethnidty exist in most of the items 
on what is important to students. In order to pinpoint where the differences lay, 
between which particular radal/ethnic groups, it was necessary to refer to the cells of 
the cross tabulations. Being rich was significantly more important to blacks and hss 
important to Hispanics than the other racial/ethnic groups. 'Friends' were more 
important to whites than to Asians and blacks. 
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Table 7.2 



Sumrn?Ty of 0)i Squara Tests of Differences in Students' Values: 
By Gttnder. Race/Ethnidty. Grade, and School 





Value 


Gender 


Race/Eth. 


Grade 


School 






(df-4) 


(df-16) 


(df-8) 


(df-12) 


A. 


Family 


2.51 


12.25 


6.76 




B. 


Beina rich 


54.23"" 


80.68"" 


8.77 


A. 


c. 


Friends 


8.15 


44.42"* 


5.67 


13.k_ 


0. 


Future education 


16.32" 


38.47** 


7.39 


19.70 




Having fun 


7.29 


29.63* 


18.77* 


13.38 


F. 


Getting good grades 


11.20* 


47.86**** 


14.27 


39.19**" 


G 


Feeling safe 


24.93"" 


32.20** 


6.54 


28.80" 


H. 


Helping others 


24.05"" 


30.63* 


7.96 


13.58 


1. 


Having a job now 


18.13" 


36.54** 


14.04 


49.70**** 


J. 


Future job 


3.59 


21.95 


11.96 


10.99 



*p < .05 
'*p < .01 
**p < .001 
"p < .0001 



'Future education' was very important to the vast majority of the students; as 
reported eariier, more than 83% of the sample chose the top rating category to report 
the importance of this value. But those reporting it to be of lesser importance were 
more often white. A rating of '5' was chosen by 84% of the Asians, 87% of the blacks, 
82% of the Hispanics, and 85% of the 'Others', but only 72% of the whites. The 
diminished importance of education for whites in the sample is also reflected in the 
responses on the importanca of 'getting good grades.' Again the dear majority (79%) 
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of VriB sample valued this most highly, but the figure drops to 65% for whites and 
increases to 85% for Hispanics. (In concert with responses from several other items, 
these findings suggest the emergence of an underdass of white males who attend the 
inner city middle schools which the st dy addresses. This issue will addressed more 
fully at the end of this chapter.) 

'Having fun' was significantly more important to whites and significantly less 
Important to Asians than to the other groups. The importance of 'feeling safe' was 
rated somewhat lower by whites, as opposed to blacks, who rated it highest. 
Hispanics rated the importance of 'helping others' somewhat more highly than all 
other groups. Blacks, who also rated being rich more highly than others, were also 
more likely to report higher importance for having a job now. 

Differences by Grade 

Analysis of student ratings on the importance of the values given in section 35 
of the questionnaire produced virtually no differences according to grade. Only one 
X2 in the 'grade' column of Table 7.2 is statistically significant. The aoss tabulation 
for that item reflects that eighth graders place slightly more importance than sixth 
graders on having fun. 

Differences by School 

Analysis of four of the ten items on values yielded significant differences by 
school. However, closer inspection revealed that all of these differences can probat)ly 
be explained by disproportionate representation of certain racial/ethnic groups in the 
school and/or imbalance by gender. Students in School 3 were significantly more 
likely to place high importance on 'being rich,' but students in this school were 
disproportionately black and male (who were more likely to value being rich 
regardless of the school they were in). 

'Getting good grades' was rated very important by significantly higher 
percentages of -riudents attending School 1 and 3 (83%) than Schools 2 and 4 (73%). 
However, e9;iier, a highly significant difference by race/ethnidty was reported for this 
Item; 85% cf Hispanic students rated 'getting good grades' very important while only 
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65% of th9 whites did so. Hispanics were overrepresented in School 1; whites were 
disproportionately overrepresented at Schools 2 and 4. 

Students in School 4 reported somewhat higher importance on 'feeling safe ' 
than the students in School 2. but females overall rated safety higher than males, and 
School 4 was the only school in the sample which enrolled more females than males 
(52% versus 48%). while School 2 enrolled a substantially higher percentages of 
males (59%). 'Having a job now" was judged to be very important by a significantly 
higher proportion of students in School 3 than School 4, but again. School 3 had a 
disproportionate representation of blacks and males (who are more likely to value a 
current job regardless of the school they are in), and again, School 4 had more 
females. 

Willing Teachers and Receptive Learners 

Teachers' responses to their questionnaire and to interviews are reported nnore 
fully in later chapters, but their replies to an iteni in the Teacher Questionnaire are 
previewed here to suggest where the teachers stand on the teaching of values. The 
discrepancy between teacher judgements of how successful their schools were in 
teaching moral/ethicii values versus how high a priority their schools should place on 
the issue is fifth highest, among 31 such comparisons. Clearly, the teachers were 
reporting that the schools need to do better in meeting students' needs in moral 
education. 

The students made an even more strenuous case for the teachers' taking up 
this responsibility. Item 21 of the student questionnaire asked them to check the three 
most important responsibilities of the teacher's job in their school. More than 98% say 
"to help us learn," but the responsibility rated next, by 77% of the students, was "to 
teach us right from wrong." "It comes with the territory." By comparison, 41% chose 'to 
be our friend;' the same percentage checked "to make us behave," and only 11% 
chose "to take care of us" or "other". 

Evidence for Dispelling the Stereotypes 

The analysis of the importance of values by race revealed several important 
differences which were not always consistent with conventional stereotypes. Asians 
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placed heavy emphasis on the importance of family and education, as expected. And 
so did Hispanics, who also varied from the norm in their lesser importance on being 
rich and greater importance on getting good grades. However, Hispanic youth who 
are supposedly excessively social according to the stereotype, reported values for 
friends and having fun, which were dose to the norm for all groups. More importantly, 
tha Hispanic students were significantly higher than the norm on the more altruistic 
value for helping others. Both the Asians and the Hispanics report values which 
appear to reflect striving immigrant groups. 

Blacks repoi^ed values which are similar to those of other racial/ethnic groups, 
with two exceptions. Blacks placed significantly greater importance on being rich, 
especially as compared to Asians and Hispanics, and significantly greater importance 
on having a job now. 

The greatest number of significant differences contrasted the whites in the 
sample from the other racial/ethnic groups. Whites in the sample placed significantly 
greater importance on friends and having fun and significantly lesser importance on 
future education, getting good grades, feeling safe, and having a current job-all of 
v\^ich suggest a lack of vision for the future and living for the present. 

The Presence of an Underdass 

The teaching of moral/ethical values and the nurturing of faith in the benefits of 
hard wori< and of hope in one's future may be of espedally critical importance to some 
of the students in the sample. Economic deprivation cut across radal and ethic groups 
in the sample, but different psychological profiles seemed to emerge for these groups, 
some according to stereotape, some not. The whites who attended the schools in our 
sample appeared to reflect the characteristics of an underdass, 'those who no longer 
dream the American dream, who cannot imagine wori<ing hard and moving from 
where they are to where they would like to be, who do not seek employment, who 
have conduded the game is lost' (Chicago Tribune, 1986). It is widely held that 
Hispanics and blacks constitute most of the underclass, yet in the schools of our 
sample, it would appear to be the whites (albeit whose numbers are small) who were 
proportionately more likely to reflect the hopelessness of the underdass. 
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Very few whites attended the four schools; they constitute 9.1% of the sample 
overall, but more striking than their unden-epresentation in the school enrollments, was 
that they were oven^elmingly male (64%). It appeared that white families in the 
school district who had any financial discretion chose to send their daughters to 
parochial schools and not to the public schools in t a sample; if,with limited financial 
disaetion, they had to choose between sending a son or sending a daughter of 
compulsory school age to one of these public schools, they chose a son. Unofficial 
estimates from knowiedgeabie sources in both the public and parochial schools in the 
area confirmed these suspicions. 

The enrollment figures for whites rangeed from 6.2% to 7.2% in the 
academically less effective schools, to 10.8% and 12.6% in the academically more 
effective schools. It is shown in later chapte*^ that the whites in these schools were 
not behind their classmates on tests of achievement, but their responses to items of 
psychological content were cause for concern. As noted eariier, school was important 
to the vast majority of students (96%), but whites were three to four times more likely 
than other racial/ethnic groups to be in the small mincity who said school was not 
important. Asked to check the three most important reasons for coming to school. 
94% to 95% of Hispanics, blacks, and Asians replied first 'to learn', but only 84% of 
white chose this option, instead, skipping over it to chose 'see my friends' in 
significantly greater percentages than the other groups. 

Responses to the question on important adults in their lives also varied by race. 
Fully 98% of students in al! groups chose 'Mother' among the three most important 
adults in their lives, except the whites, whose figure dropped to 94%. In choosing 
'Father', the second option on the list, Asians reported 94% and Hispanics 90%. but 
blacks and whites drop to 81% in naming their fathers as important adults in their lives. 
WNIe the portrayal of values was positive for the ovenvhelming majority of students. It 
is important to monitor tiiese values and espedally to note eariy warning signals for 
ta-oubied, disenchanted, dispirited youth. 
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Summary 



If economically disadvantaged, largely minority youth who attend urban middle 
schools hold value systems like those reported try the vast majority of students in the 
present study, there is reason to be optimistic atxxjt their futures. Teachers complain: 
'Just give me students who want to learn!' If responsive, effective education can be 
made available to these students, it's not too late, becauae these students want to be 
in school, they want to learn, and they recognize the crucial importance of education to 
the quality of their lives in the future. 

Very substantial percentages of the students used the highest point on the 
rating scale to indicate the importance they placed on family (92%), future education 
(83%), future job (83%), and getting good grades (79%). The basic human need of 
feeling safe was also deemed very important (68%), but the importance placed on 
friends, while still very substantial (42% choosing very important), was not as 
pronounced as the importance placed on family and education. The distribution of 
responses for the more hedonistic value of being rich flattened considerably; having 
fun and having a job now were also of relatively lesser importance. 

Tests of significance of differences in these values according to gender as well 
as race/ethnicity produced several significant differences. While the gender 
differences favoring the more positive outlook of females con^esponded with the 
stereotypes reported for a sample of this socioeconomic level, the differences by 
race/ethnidty hold some surprises and dkd not conform to conventional stereotypes. 
Differerx;es t>y grade were not significant, and differerx;es by school con-esponded to 
the racial and gender differences which were proportionate to their enrollments. 

Teachers recognized the importance of teaching values and serving as role 
models to their students. While these responsibilities were not among the highest 
priorities for the teachers, they reported that their schools (and by implication 
themselves) were remiss in addressing this area of student needs satisfactorily. The 
discrepancy noted between success versus priorriy assigned to this area ranked fifth 
among 31 areas rated by the teachers; teachers appeared to recognize the need to 
do more in schools about moral education of their eariy adolescent students. 
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The evidence indicates that the students held very positive traditional value 
systems: they wanted teachers to 'teach us right from wrong'; and teachers concurred 
with this need. The emergence of a very small minority in these schools whose values 
suggested they have no dream for the future but only the benefits of the present was 
disturbing. These youths who might be part of what has been temned an underclass. 
tended to be male, not female, and disproportionately white; to a lesser extent, 
disproportionate to the enrollments, they are black, but not Asian, and not Hispanic. 
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CHAPTER 8 



HOW STUDENTS SPEND THEIR TIME OUTSIDE OF SCHOOL 



The thrust of this research for effective middle schools has l5een to help schools 
assess their impact on students in a variety of areas, not just t^asic skills. The research 
seeks to provkle schools with tools yielding valid indicators of effectiveriess which can 
be used to provide tsench marks, guide choices, and monitor change. A point of 
departure for the research has tseen that schools do make a difference, however, what 
students do outside of school is also of intes ast, t}ecause that knowledge may help to 
guide choices for sc!.ool reforrr "^nd restructuring. 

Time Is Critical 

An influential book on school reform from Great Britain was entitled "Fifteen 
Thousand Hours: Secondary Schools and Their Effects on Children,' (Rutter, 
Maughan, Mortimore, & Ouston, 1979). The authors introduced their study by noting 
that: 'For almost a dozen years during a fomriative period of their development 
children spend almost as much of their waking life at school as at home.' In Great 
Britain this wori<s out to some 15,000, from the age of five until leaving school, during 
which time schools and teachers can have considerable impact on the development of 
children and youth in their care. 

For the schools in the present study, the time for potential influence is 
significantly less. Students are in school only six hours a day (three in the 
kindergarten year), for 180 days per year, over 13 years, or 13,500 hours--if they don't 
become truant or drop out. 

But Not More of the Same 

The National Governor's Association, The Carnegie Council on Adolescent 
Development (1989), the National Center for Research on Elementary and Middle 
Schools, and several national associations of professional educators, among others 
have called for the restructuring of schools to make them more effective. These groups 
recognize that superficial refinements and small increments, which are simply more of 
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the same ineffective practices, won't work. Effective reform of urban education will 
require fundamental restructuring of schools. But how students spend their time is a 
factor. Actual time spent learning is critical, and proposals to extend the school day. 
-•e school week, and even the school year may be effective for shaping students* 
benavior in a variety of positive ways. 

In the previous chapter, we noted that schools are being asked to serve as the 
conduit for a host of human services which the home can no longer provkle. This is 
especially so for the homes of economically disadvantaged minority youth, but also for 
most children in our society today. Some of the decreased capability is simply a 
function of the limited time adults and children in families now spend with each other. 
For the majority of husband-wife families with children under 18, both parents are in 
the labor force. According to data from the U.S. Department of Labor, Bureau of Labor 
Statistics, 55.1% of two-parent families had both parents working in 1987; 69.1% of 
women heading single parent households worked, and 92.1% of men in single-male- 
headed households worked. The corresponding figures for 1975 36.2%, 59.9%, and 
86.1%. Knowledgeable personnel in the schools of our sample report that their 
middle school students go home to empty households or they assume responsibility 
for the care of younger children in their parents absence. 

Gauging Students' Time Out of School 

Three sets of items were included on the student questionnaire to gauge how 
students spend their time after school, on weekends, and during the summer. 
Students were asked to report tho number of hours they spend on various activities 
after school and on weekends. They were told: 'If no hours, write 0.' Responses 
giving fractional parts of an hour were rounded up to the next full hour. For surrvner 
activities, students were asked: 'How did you spend most of your time last 
summer? Check three (3) ways.' 

Tables 8.1 and 8.2 give the percentages of students reporting how many hours 
they spend on each activity. These simple descriptive statistics provide a dramatic 
picture of the lives of urban middle school students outside of school. Their 
responses suggest what interests them and what they value, but also what 
opportunities may or may not be available, as well as what responsibilities they might 
have to their families. 
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TABLE 8.1 

How Students Spend Most of Their Time After School 



Activity IHours 





0 


1 


2 


3 


4+ 


Work outsida th« home 


82.1% 


05.2% 


03.6% 


03.2% 


05.9% 


DochoTM 


28.6% 


48.4% 


14.8% 


04.3% 


04.0% 


Do homawork 


6.7% 


50.4% 


26.3% 


09.6% 


07.1% 


Aftsrschool program 


77.2% 


13.2% 


04.7% 


02.5% 


02.5% 


Watch TV/vidaoa 


10.1% 


19.5% 


21.9% 


18.0% 


30.4% 


PlayvMaogamas 


43.8% 


28.7% 


12.2% 


06.3% 


08.9% 


Go out with my friands 


30.5% 


17.5% 


15.0% 


12.6% 


24.6% 


Raad 


33.5% 


44.2% 


13.6% 


03.4% 


05.4% 


PIcy sports 


40.0% 


21.6% 


15.2% 


11.5% 


11.7% 


Takalassoru 


86.5% 


05.4% 


03.2% 


02.1% 


02.7% 


Play music 


54.5% 


20.2% 


09.8% 


06.6% 


08.7% 


Hangout 


45.5% 


14.9% 


11.4% 


07.6% 


20.8% 


Othar 


79.1% 


06.8% 


04.3% 


03.2% 


06.9% 



TABLE 8.2 

How Students Spend Most of Their Time on Weekends 



Activity Hours 





0 


1 


2 


3 


4+ 


Work outskia of tha homa 


82.2% 


04.6% 


03.8% 


02.7% 


06.5% 


Do choras at homa 


33.7% 


33.7% 


19.5% 


06.5% 


06.6% 


Do homawork 


47.8% 


32.1% 


11.3% 


04.8% 


03.9% 


Watch TV/Vidaos 


12.2% 


14.6% 


17.8% 


15.4% 


40.2% 


Playvklaogamas 


41.5% 


21.6% 


14.9% 


08.7% 


13.3% 


Hangout 


36.5% 


10.7% 


10.3% 


11.0% 


31.8% 


Go to tha mail/shopping 


22.8% 


11.2% 


17.2% 


17.7% 


31.2% 


Go to tha movias 


32.2% 


05.0% 


26.7% 


17.7% 


18.4% 


Go church,tampla,mosqua 


53.5% 


17.5% 


11.0% 


07.0% 


11.0% 


Ray sports 


41.0% 


17.6% 


15.4% 


12.1% 


13.9% 


Taka lassons 


88.9% 


03.8% 


03.5% 


01.3% 


02.4% 


Play music 


55.9% 


15.2% 


11.2% 


05.2% 


12.5% 


Othor 


78.5% 


03.6% 


03.3% 


03.3% 


11.2% 
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Factor analysis using all 26 time variables from the lists of after school and 
weekend activities yielded 10 significant factors with eigenvalues greater than one. 
Together the factors accounted for 69.4% of the variance. However, several of the 
factors were two-item factors, i.e., they had two items with very high loadings ranging 
in the .70's to high .80's, and loadings on ail other items approaching .00. Inspection 
of the item content revealed that where pairs of items existed in the after school and 
weekend lists of activities, the pairs loaded together on the same item. If students 
spent time playing music after school, they tended to do so on weekends too. The 
same could be said for playing sports, working, watching TV, and 'other' activities; 
whatever they did after school during the week, they did on weekends. 

Two four-item factors also resulted. Students who played video games were 
the ones who reported hanging out, boVn after school and on weekends. This 
combination of four very high loadings came out dearly on the first factor. The second 
factor also included four high loadings, for doing chores, and doing homework, both 
after school and on the weekend, suggesting that the structure and responsibility 
reflected by students' doing chores "'as also operative for homework. 

Since the factor analysis of 26 items yielded 10 underlying constructs, while 
joining of like items reduced the data to almost as small a number of variables, it was 
decided to use the simpler data directly, and forego the calculation of factor scores and 
the labeling of multiple item factors. Instead, a composite week of time spent on a 
given activity was calculated for those items which were included kx>th in the list of 
after school activities and the list of weekend activities. Thus, the student's response 
for hours spent after school on a given activity was multiplied times four (for school 
nights) and the product added to the time he or she reported spending on that activity 
on the weekend. If a weekday activKy had no weekend counterpart, or vice versa, no 
transformation was applied and the original responses were used in subsequent 
analyses of those items. The subsequent analyses were four-way analyses of 
variance~by school, grade, sex, arxl race-to determine if there were any significant 
differences in the ways students spend Vt sir time if they are grouped according tho 
these factors. A summary of the statistically significant findings from these four-way 
ANOVA's is presented in Table 8.3. Complete AMOVA tables are available from the 
Project Director. 
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TABLE 8.3 



Summary of Significant F Ratios from Four-Way Analyses of Variance of How Students 
Spend Their time Outside School, and Results of Duncan Tests of the SisnificanGe of 
Mean Differences on Significant Main Effects: School, Grade, Sex and Race 



ANOVA Effects: 

DMfMS of FrMdom 


School 

3 


Grade 

2 


Sex 

1 


Race^ Interactions 

4 


Afterschool Program 


NS 


NS 


NS 


NS 


SchXRace 


Read 


NS 


NS 


5.12* 
M<F 


NS 


NS 


Go out with friends 


NS 


NS 


NS 


7.93*"* 
A<HW<OB 


NS 


Work outside the home 


NS 


NS 


7.70** 
F<M 


3.34** 
OAB<W 


NS 


Do chores at home 


NS 


NS 


16.42*"* 
M<F 


NS 


NS 


Do homriwork 


NS 


3.14* 
6<7<8 


NS 


2.S3* 
OWHB<A 


NS 


Watch television 


NS 


NS 


NS 


2.85* 
WHA<BO 


NS 


Play video games 


NS 


NS 


29.81*"* 
F<M 


NS 


NS 


Play sports 


NS 


5.11" 

0,/<O 


71.39**" 

P<M 


4.07** 

A<HOW<B 


GrXRace 
SexXRace 


Tal<e Lessons 


NS 


NS 


NS 


NS 


NS 


Ray Music 


NS 


NS 


7.89** 
M<F 


5.69*"* 
AW<OHB 


NS 


Go to the mall/shopping 


NS 


NS 


?7.38**** 
M<F 


7.57*"* 
AHW<B 


NS 


Church,temple,mosque 


NS 


NS 


4.62* 
M<F 


3.27** 
A<HWBO 


GrXRace 



"Raci/tthnidty is cod«d ' ^Asian. B-black, H-Hi^ic. W-whita. & id 0-other. 
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TABLE 8.4 



Percentages Reporting Whether They Have a Job, Chi Square Tests of Significance 
And Summary of Four-Way ANOVA of Hours Spent Working, 
By School, Grade, Sex, and Race 



Basis for Grouping 


Havinoj 


iJob 


Chi Souare 


F Ratio 


Yes 


No 


Yes/No 


Hours 




21 7% 


78.3% 




X=8.3 


By School 






NS 


2.78* 
3.K4 


School 1 
School 2 
School 3 

School 4 


20.4% 
21.1% 
25 6% 
2?.4% 


79.6% 
78.9% 
74.4% 
77.6% 






By Grade 






9.AC" 


6.01" 
6,7<8 


^iyth amHars 

Seventh graders 
Eighth graders 


24 6% 
17.0% 
22.8% 


75.4% 
83.0% 
77.2% 






By Sex 






24.86"" 


4.61* 
F<M 


Males 
Females 


26.6% 
15.9% 


73.4% 
84.1% 






By Race/Ethnidty 






32.39"" 


2.57* 
H,B<W 


Asians 

Blacks 

Whites 

hispanics 

Others 


14.4% 
26.4% 
33.6% 
16.8% 
25.6% 


85.6% 
73.6% 
66.4% 
83.2% 
74.4% 







•p<.05 
**p < .01 
•*p < .0001 
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Urne Spent on Out of School Activities 



In the sections which follow, the simple descriptive statistics on percentages of 
students who participated in each activity are noted for each activity. Results are ?\so 
given from the analysis of variance tests to show what significant differences exist 
among groups, by school, grade, sex, and race. 

Working Outside the Home 

Fully 82% of the students reported in items 1 1 and 12 that they spent no time 
working outside the home. Analysis of variance of the hours spent working by 
students in a composite week (4 times the hours reported for after school, plus the 
hours spent on a weekend) showed that there are signifk:ant differences by sex and by 
race. Males report on average working outside the home nearly twice as many hours 
as the females (3.51 for males versus 1.81 for females, F - 7.70, p < .006). Duncan 
multiple range test sliowed that the signifrant effect for race (F - 3.34, p < .01) was 
obtained because of those who workvKt, v/hites averaging 4.24 and Hispanics 
averaging 3.52 hours per week worked significantly longr^ than Asians (1.17 hours) 
and in tum those in the 'oVner' category who averaged just .58 hours per week. 

These results are consistent with those obtained from an ''.em on similar content 
on the questionnaire. Item 14a asked: 'Do you have a job outside the home?' Of 
those responding 78.3% said 'No.' Those who said 'yes' had a mean of 8.3 hours for 
item 14b: 'If yes, how many hours per week do you work?' Chi squares were used to 
analyze differences by grade, sex, race, and school in the dichotomous variable, 
having a job or not. These results are given in Table 8.4. The results are consistent 
with the outcomes of the ANOVA test reported previously on hours spent working 
outsrJe the home. No school differences were significant in the chi square analysis, 
but males were significantly more likety than females to be working outsiae the home 
(26.6% versus 15.9%). The factor of race/ethntoity was also highly significant; white 
students were frj more likely to have St job than nonwhites; Asians and Hispanics 
were least likely to report having a job. 

The Chi square for grade differences in having a job was significant at p < .01. 
Surprisingly, sixth graders were mcie likely to report having a job (24.6%) than eighth 
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graders (22.8%) and in turn seventh graders (17.0%). txrt, as determined by analysis 
of variance, those sixth and seventh graders who did have a job vvorked a significantly 
lower number of hours than eighth graders who worked. The four-way analysis of 
variance was used to study differences in students' reports on the number of hours 
they work, not only by grade, but also by school, sex. and race. These results are also 
summarized in Table 8.4. All main effects were significant, with no interaction effects. 
Males worked outside the home a significantly higher number of hours per week than 
females. Students at School 4 worked signifk:antly more than students at Schools 3 
and 1, but this may simply reflect the higher representation of certain minorities in 
those schools-blacks and Hispanics respectively. Whites worked significantly more 
than black arxJ Hispanic students. 

Doing Chores 

Alnwst half of the students (48.4%) report spending an hour on chores after 
school, and 2.3% report two or more hours a day doing chores after school. The 
average overall for a composite week is 6.4 hours, txjt there is a highly significant sex 
difference on this variable (F - 16.42. df - 1. p<.0001). Females reported spending 
almost twice the time doing shores as males. 8.2 hours versus 4.7 hours. The sex 
difference in the previous activity should be noted again; males reported twtee the 
number of hours working outside the home (no doubt for pay) as females. 3.5 versus 
1.8 hours. But on net. tiie females are working more, probably for low or no pay. 
reflecting a sex difference which gets established very eariy in life. 

Doing Homework 

Happily, a very small percentage of students (6.7%) reported Coing no 
homework on a typteal day after school; half (50.4%) reported spending an hour, and 
more than a quarter (26.3%) of the students said they spent two hou-'s on homework 
after school. However, the picture on weekends was not so positive. Almost half 
(47.8%) reported doing no homework on weekends, and barely a third (32.1%) 
reported spending one hour; 1 1.3% reported spending two hours of the weekend on 
homework. The overall average for a composite week was 8.2 hours. 

The four-way analysis of variance on this variable produced two significant 
main effects and no significant interaction effects. As seen in Table 8.3. the F ratio for 
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grade was significant at p < .05; not surprisingly, students reported longer hours of 
homewori< each week as they advanced in grade level. The F ratio for differonces 
according to race/ethnidty was also significant, at p < .02. Again not surprisingly. 
Asians reported spending substantially longer hours doirig homework that students in 
all other radal/ethnk: groups. This difference of approximately 6 hours per week 
correlates with the higher achievement levels wWch Asians demonstrate on measures 
to t>e reported in later chapters. 

Going to Afterschoo l Programs 

The great majority of students (7: .2%) have no involvement in after school 
programs. As seen in Table 8.1, 13.2% report spending up to an hour each day in 
after school programs and less than 10% spend two hours or more. The mean time 
spent in after school programs for the total sample is only 27 minutes. Asked why this 
was so, school officials confirmed that budget cutback forced discontinuation of most 
after school programs, and many students are not able to take advantage of the few 
that remain. Transportation schedules pre* ant many students from staying after 
school; and parents, particulariy 'Asian parents' and 'parents of daughters' want their 
children to 'go straight home.' 

Analysis of variance of the number of hours spent in after school programs each 
day produced no significant main effects, but one curious interaction effect was found. 
The F ratio of 2.32 for race by school differences was significant at p < .01 , because 37 
Hispanic students at School A reported an average of 2.76 hours on some after school 
program(s). when the cell averages ranged from . 10 to 1.00 hours. 

Watching TV or Videos 

Regrettably but not surprisingly, the urtaan middle school students in our sample 
reported spending more time watching television, both after school and on weekends, 
than engaging in any other activity. After school, 90% reported watching one or more 
hours of television, almost '^0% two or more, almost 50% three or more, and 30% four 
or more. On weekends, some of the weekday TV watchers find other things to do, so 
one- two- and three- hour viewing categories decline by approximately 5%, 4%, and 
3% respectively, but those in the four plus hours of viewing category increases by 10% 
from weekdays to weekends. 
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The analysis of variance of hours spent watching television in a composite 
week produced only one significant effect, for race, at p < .03. Blacks were 
significantly more likely than Asians, v^ites, and Hispanics to watch television by a 
difference of two or more hours per week. These findings are consistent with those 
published in Youth Indicators 1988: Trends in the Weil-Being of Americzn Youth by 
the U.S. Department of Education Office of Educational Research and Improvement, 
which also funded the present study. Black students in grade 8 were more likely than 
Hispanics or v^ites to watch TV more than 2 hours per day (NAEP, 1986). Asians 
were not identified as a separate radal/ethnic group in the N.AEP report. 

Plavino Video Games 

More than 40% of the sample reported not playing video games, after school or 
on the weekend, but of the almosi 60% v^o do, 29% report spending one hour after 
school, 22% on weekends, with the difference going to the higher rates of use on 
weekends. Students in the socioeconomic brackets of the sample may not have 
Nintendos or computers with software games at home and instead have to go to 
arcades which they are more likely to visit on weekends. 

Hours spent in a composite week playing vkleogames averaged 6.65 hours for 
the entire sample, but analysis of ^/ariance yielded a highly significant sex difference. 
Males were much more likely to spend time on videogames than females, 8.89 versus 
4.23 hours, F - 29.81 , p < .0001 . A curious race by grade interaction effect was also 
observed; time spent playing video games declines over grade levels for all 
radal/ethnic groups except Asians, for whom a startling inaease occurs from seventh 
to eighth graders, from 2.90 to 15.06 hours per week. 

Going Out with Friends 

This item was included only in the list of after school activities: inadvertently it 
was omitted from the list of weekend activities on the student questionnaire. Factor 
analysis of both sets of items, weekday and weekend activities, placed it in the same 
cluster of items as taking lessons both after school and on weekends, and with 
reading. Analysis of variance for this item produced only one significant effect, for 
race/ethnidty, on which Asians scored significantly lower than all other categories. 
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Liko the previous activity, reading was also included only in the after school list. 
(The marvels of word processing caused us to repeat our mistake.) One-third of the 
students in the sample reported doing no reading after school, but 44% read for an 
hour, and 22.4% read for two hours or more each day after school. The ANOVA of 
time spent after school in reading produced only one significant interaction effect, for 
sex. Females were more likely than males to read after school, with average times 
reported of 1 .38 hours for females and 1 .00 hour for males. 

Raying Soorts 

Playing sports for an hour or more both .er school and on weekends was 
reported by 60% of the students. The average time spent in a composite week was 
seven hours for the total population, but the analysis of variance produced several 
significant main effects and interaction effects as well. Sixth graders reported playing 
sports more frequently than seventh or eighth graders (8.61 hours versus 6.54 and 
5.32 hours). Males were more than twice as likely th«ui females to spend time playing 
sports 9.80 versus 4.08 hours (F = 71.39, p < .0001). Asians were significantly less 
likely to be playing sports as other groups, especially blacks and whites. 

Two significant interaction effects were also observed in the analysis of 
variance for time spent playing sports. First, a race by grade effect showed declines in 
time spent on sports over grade level for all racial/ethnic groups except Asians where 
a marked increase occurs between grades seven and eight. (The same pattern was 
obsen/ed for video games). In addition, significantly different ratios of male to female 
participation in sports were found for various radal/ethnic groups; the ratio of hours 
spent for male versus females was 2: I for Asians, 2.4:1 for blacks, 3:1 for whites as 
well as Hispanics, but 1:2 for the 'other' category. 

Taking Lessons 

The vast majority of students in tiie sample did not take lessons of any kind. 
ANOVA of group differences produced no significant main effects and no significant 
interaction effects. 
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Playing Music 



This item could have been interpreted by the students to mean 'listening to a 
Walkman or other radio/stereo system' (as intended by the designers of the 
questionnaire) or 'playing a musical instrument,' or both. Several pilot tests did not 
reveal any confusion on the part of the students, and so the item survived to the final 
form. A surprisingly high percentages reported not playing music either after school 
(54.5%) or on weekends (55.9%). Among those who did, several group differences 
emerged from the analysis of variance of the measure for the composite week. 
Females reported significantly more time playing music than males, 7.99 hours versus 
4.76 (F = 7.89, p < .005). Blacks, Hispanics, and 'others' were far more likely than 
whites or Asians to spend time playing music. The mean hours were 8.42 , 7.33, and 
7.22 for the first three groups respectively, and 2.63 and 1.79 hours for the list two 
groups. 

Hanging Out 

Hanging out was the final category which appeared on the lists of both after 
school and weekend activities. More than half of the students (54.5%) reported 
spending time hanging out after school; while the hours declined for most of the 
students, the percentage shot up to 20.8% for students who spend who spend four or 
more hours per day hanging out, as opposed to some more purposeful activity. Time 
spent hanging out increased on the weekend, and the percentage who spend four or 
more hours doing it rose an additional 1 1 points to 31.8%. 

The four-way analysis of variance for this item produced significant main effects 
for school, sex, and race, as well as one significant interaction effect for school by race. 
Students from the two schools to which many are bused (Schools 2 and 4) reported 
significantly less time hanging out than students in the largest school which had a 
moderate amount of bussing (School 1 ) and especially the neighborhood school to 
which most students walk (School 3). Males reported significantly more time each 
week hanging out than females (11.39 hours versus 9.55; p < .05). The overall 
difference by race was highly significant, with blacks spending more than twice as 
much time hanging out as Asians and Hispanics, and approximately 50% more than 
whites. 
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The significant interaction effect for school and race reflected the finding that 
among students at the neightxsrhood school, blacks and especially Hispanics spent a 
great deal more time hanging out and whites and Asians considerably less ^me 
hanging out than the means for their radal/ethnic groups overall. The reports of blacks 
at one of the 'busing schools,' School 2, reported time spent hanging out which was 
approximately twrce the school average. 

Going to the Mall/ShoooinQ 

This and the remaining items appeared only in the list of activities for the 
weekend. Almost 78% of the students reported spending at least some time going to 
the mall/going shopping on the weekend. For 31.2% it is a major event of the 
weekend on which they spend four hours or more. 

Analysis of variance for this item produced a significant sex difference in the 
predictatsle direction. Not surprisingly, females reported spending more time going to 
the mall/shopping than males, 3.30 hours versus 2.26, a difference which begins at an 
eariy age and probably continues throughout the lifespan. One interaction effect (race 
t>y school) for time spent going to the mall/shopping was significant at the .05 level. 
Asians in School 2 and the very small number of whites in school 3 were significantly 
less likely to go to the mall/shopping. Several reasons are plausible, including lesser 
interest/value for the activity, and, quite possibly, lesser access to transportation to get 
to a mall. Money to buy things may have littie to do with whether young teens frequent 
the lalls. They go there to socialize and be with their friends, not always with the 
blessing of shop proprietors and other age groupsUacobs, 1990). 

Going to the Movies 

Students who go to the mall are the ones likely to be going to a movie too. Only 
5% report one hour's time devoted to the movies on weekend; but few films are as 
short as this. More than a quarter of the students reported spending two hours at the 
movies on weekends, while 36% claim to spend three hours or more. The analysis of 
variance yielded no significant main effects for this variable, but one significant 
Interaction effect was obsen/ed, for race by school. Proximity to movies theaters and 
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access to public transportation in combination with different racial/cultural patterns on 
this activity may account for the differences. 

Going to Church. Te mple or Mosaue 

More than half of the sample of middle school children (53.5%) reportedly 
spend no time in formal religious observance on the weekend. Analysis of variance 
for this variable yielded significant main effects for sex and race and significant 
interaction effects for school by race and for grade by race. Females were significantly 
more likely than males to participate in some fonnal religious observance on the 
weekend. Asians were significantly less likely than all other groups to go to church, 
temple or mosque on the weekend. Accounting for the significant race by school 
interaction effect, those in the "other" category at School 1 spent two to three times 
more time in services than their counterparts at other schools, and whites at School 4 
spent two to four times the number of hours in religious observances as their 
counterparts in the other schools. In addition, the "others" in grade six and the whites 
in grade 7 reported significantly more time attending services, a curious result which 
knowledgeable otsservers in th«) schools cannot explain. 

Correlations with Achievement Measures 

Individual and composite time measures were correlated with achievement 
measures to investigate whether the way in which students spend their time might 
influence how well they perform academically. The achievement measures includes 
four test scores- the specially developed Test of Problem Solving (TOPS), the Boston 
Public School's Criterion Referenced Test in Mathematics, and the Metropolitan 
Achievement Tests of Reading and Mathematics-and five final grades, in reading 
English, mathematics, science, and social studies. 

The con-elations ranged in magnitude from .00 to .26, and the vast majority were 
negative, suggesting that the reported after school and weekend activities detracted 
somewhat from test scores but more from school grades. Most figures were 
statistically significant, a function of the large sample sizes. TV viewing correlated 
dose to zero with most achievement me^^sures. Doing homework had low positive 
correlations v^nth some grades but nonsignificant corelations vyitti test scores. Playing 
sports correlated negatively with grades (-.11 in science to -.20 in English), but had no 
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correlation with any of the four test scores. Playing music con-elated negatively (-.16 to 
-.251 with test scores, math and science grades, but not with the other grades. 
Spending time seeing friends, hanging out, and going to the movies correlated 
negatively with ail achievement measures (correlations ranging from -.12 to -.25) 
except with ttie Meti'opolitan Reading Test and final grades in English, where the 
cor'-elations were not significant. Con-elations between achievement measures and 
religious observance on weekends were not significant, except with the Meti'opolitan 
Achievement Tests which correlated -.12 in mathematics and .-14 in reading. (Asians 
who tend to be the highest achieving are less inclined than other racial/ethnic groups 
in Vhe sarrple to participate in rdligious services on weekends.) 

The time measures were used in multiple regression equations to predict each 
of the four achievement tests and the five final grades. Across Vne nine computer 
analyses, the program used between one and six time measures as statistically 
significant predictors, but in no case was the R square as high as .10. Collectively. Vne 
time variables contribute no more tiian 10% to explained variance in tiie achievement 
measures. 



Summer Vacations 

A different response fomiat was used to elicit students' reports on how they 
spend most of tiieir time last summer. From a list of eleven options, including 'other,' 
they were asked to check the three ways they spent most of their time. Their 
responses in Table 8.5 are given as percentages who checked each item as one of 
tiieir top tiiree responses. 

Among first checks, almost one third indicated 'help around the house,' 
skipping over the item in first position, 'work outside tiie home' because most of the 
students in the sample are too young to wori< legally. Very few reported going to 
sunrvner school, only 10.5% overall. One quarter went to camp. Playing sports drew 
the largest number of second checks, and across the tiiree, totaled 43.4% of the 
students, Vhe second highest use of summer time overall. 

'Travel' received the highest percentages of checks across all ti^ree columns, 
46% overall. While travel seems an unlikely option for tiie most frequent use of 
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TABLE 8.5 

How Students Spend Their Time During the Summer 



Activity 


Percentage Choosing Among Three 
First Second Third 


Composite 

Percentage 




Rank 


Work outside the home 


15.9% 






15.9% 


7 


Help around the house 


31.9% 


5.2% 




37.1% 


3.5 


Go to summer school 


5.7% 


4.2% 


.6% 


10.5% 


10 


Goto camp 


15.5% 


8.5% 


1.4% 


25.4% 


s 


Play sports 


14.5% 


23.9% 


5.0% 




9 


Travel 


99% 


22.0% 


14.1% 


46.0% 


1 


Stay home 


4i.7% 


6.9% 


4.4% 


14.0% 


8 


Watch TV/videos 


1.2% 


10.9% 


12.1% 


24.2% 


6 


Play video games 


3Fh 


3.7% 


8.3% 


12.3% 


9 


Hangout 


9% 


4.7% 


32.3% 


37.9% 


3.5 


Other 


.1% 


2% 


7.5% 


7.8% 


11 



summer time among an economically disadvantaged population, it may be that 
parents of these inner city students give high priority to gettinc their children out of the 
city during the summer, either k>y leaving with them or more likely, sending them to visit 
relatives. Item placement, i.e., the order in the list, and social desiratdil'ity may be 
influencing students' choices on itiis question as much as item content (actual summer 
activity). 

Watching TV, staying home, and playing videogames were not frequently 
reported activities, perhaps due to late placement on the list, or perhaps because 
students were tired of these activities which take up much of their time during the 
school year. 'Hanging out' was chosen as frequentiy as 'helping around the Jwuse.' 
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Doing Volunteer Work 

A separate item on the questionnaire inquired whether the students did any 
volunteer work, and if so, what, and how often. Item 15a inquired: 'In the last year, 
have you done any volunteer work (helping a good cause for no pay)?' Overall, 26.5 
% of the students responded yes. Of those who did, 51 .5% reported that they dki so 
weekly, 1 1.9% monthly, and 36.6% a specific number of times. Typical of the services 
they volunteered were 'helping elderly people at hospital', 'helping elderly with 
grocery shopping', 'bat)ysitting underprivileged kids', 'walk for hunger', 'help clean 
park', "help at church', and 'dean up my mother's house'. 

Chi square analyses were conducted for differences according to grade, stx, 
race, and school both on the dichotomous variable of whether students did volunteer 
work or not and on the frequency rated weekly, monthly, or otherwise. Results are 
reported in Table 8.6. A significant grade difference was found, with sixth grade 
students more likely to report doing any volunteer work than students in seventh grace 
or, in turn, eighth grade. Whites, 'others', and blacks were significantly more likely to 
report doing volunteer work than Hispanics and especially Asians who reported the 
least. No significant differences were found for sex or school factors. For those who 
did report doing volunteer work, no significant differences were observed in the 
frequency according to grade, race, sex, or school. 

Summary and Discussion 

The four urban middle schools in our sample are in session for students exactly 
six hours each day. One with a delayed opening begins at 8:30 a.m. and ends at 2:30; 
the three others begin at 7:40 a.m. and send students home at 1 :40 p.m. According to 
school personnel, many of these students go home to empty houses, where they 
watch TV and care for younger siblings who attend the elementary grades. Our data 
confirm the extent of television watching. Fully 90% watch for at least an hour, 70% 
watch TV for two hours or more, 30% for four hours or more after school. These 
viewing rates exceed what was reported nationally fo^ high school seniors in the dass 
of 1985 (U.S. DOE-OERI, 1988. p. 109). Approximately 75% of high school males and 
69% of the females in that graduating dass reported watching TV after school. It was 
their most cormion daily activity. 
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Percentages Reporting Whether They Do Volunteer Work and 
Chi Square Tests of Significance of Differences by 
School. Grade. Sex. and Race 



Basis for Grouping 


Yes 


No 


Chi Souare Values 
Yes/No Frequency* 


Overall 


26.5% 


73.5% 




By School 






NS NS 


School 1 
School 2 
School 3 
School 4 


24.4% 
26.2% 
24.1% 
32.2% 


75.6% 
73.8% 
75.9% 
67.8% 




By Grade 






27.48 NS 


Sixth graders 
Seventh graders 
Eighth graders 


33.7% 
24.2% 
19.5% 


66.3% 
"5.8% 
80.5% 




By Sex 






NS NS 


Males 
Females 


ZO.4 ,X> 

27.6% 


72.4% 




By Race/Ethnidty 






37.07"" NS 


Asians 

Blacks 

Whites 

Hispanics 

Others 


12.4% 
30.8% 
36.4% 
23.5% 
35.9% 


87.6% 
69.2% 
63.6% 
76.5% 
64.1% 





"p < .0001 



*0f those students yMlt\o reported they had done volunteer work in the past year. 
L 1.5% said they did it weekly. 1 1.9% monthly, and 36.6% a specific numljer of times. 
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The figures in Table 8.1 suggest that those who don't go home and watch 
television go out with friends after school, or simply 'hang out.* Almost 70% of the 
sample reported going out with friends for an hour or more and a quarter (24.6%) 
spent 4 or more hours this way. "Hanging out' occupied more than half (54.5%) the 
students for an hour or more each day, and for 20.8% it consumed four or more hours 
a day. 

Fully one-third spent no time reading after school, but 44.2% claimed to read for 
one hour, few more than that. Half of the students reported spending an hour on 
homewori< after school, another 26.3% spend two hours; 16.7% spend three hours or 
more, but only 6.7% claimed to do none. The low percentages of time spent reading 
probably reflects choice but also may reflect lack of opportunity, i.e.. the scarcity of 
reading material in the home. Three of the four schools reported that teachers are 
reluctant to send students home with text books. There are not enough to go around, 
and the teachers fear the short supply will dwindle further. Instead, they prepare 
students wilh wori^eets or assignments in their notebooks. 

It is dear from the data that the students have very few choices available to 
them. More than three-quarters do not go to after school programs, mostly because 
they are not available. Even fewer take lessons, for example in dancing, music, or 
language, because lessons are beyond the means of most of these families. Most of 
the children leave school by 1:40 p.m., and they have little else to do but watch 
television, see friends, and hang out. for four or more hours, until their parents get 
home. 

Weekends present a similar picture of unstructured social activity with even 
more television viewing and considerably less homewori<. There are no Saturday 
programs at their schools for these students. Even playing sports occupies very little 
time for most erf the students; <10% report no time during the week on sports and 41% 
spend no time playing sports on the weekend. Slightly more than a quarter play sports 
on the weekend for three hours or more; considerably more students prefer to just 
hang out. Opportunities to play s|3orts may be very limited; playing fields other than 
hardtop playgrounds in disrepair are not in evidence in the areas which these school 
sen/e. 
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Playing sports preempts television, video games, and hanging out in terms of 
popularity as a summer activity. It rnay be that pools, rinks, and playing fields 
supervised by the Metropolitan District Commission in the areas where these students 
live are available during the summer, but not during tha school year. The data overall 
indicate that the student's choice on how to spend free time is very limited. 

Volunteer work is something that 26.5% of the total sample has tried. But the 
involvement drops off significantly as students advance to higher grade levels. Many 
educators and other concerned citizens point out that volunteer work is important as a 
socially desirable and influential activity in its own sake, quite apart fran its possit)le 
influence on student achievement. If this is so, more opportunities ought to be made 
available to students to engage in such work. The picture which emerges from the 
data overall is that students have few choices and little structure to guide productive 
use of their time. 

Extending the school day, week, or year to include more of the same things 
which presently go on in schools with disappointing results is not the answer. But 
purposeful, structured activrlies with appropriate resources and adult supervision 
ought to be made available to these students. 

Recommejpded Item Revisions 

Schools and school systems wishing to survey their students on how they 
spend their time should consider using different response formats for some of the 
items. Aft3r school activities which are likely to occur daily may be retained in the 
same fomiat as that shown in item 1 1 -doing chores, homework, watching TV, going 
out with friends, reading, playing sports, and hanging out. Babysitting should be 
added to the list, perhaps as two items-babysitting for younger brothers and sisters, 
and babysifing for another family. Certain after school activities may not occur daily, 
likfi working, going to an after school program, and taking lessons. These items 
should be separated from the others and their response format changed to "how many 
times each week,' "for how long.' Despite multiple pilot tests of the instrument, these 
points of confusion did not surface until the final administration of the questionnaire. 
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CHAPTER 3 



FROSOCIAL AND ANTISOCIAL BEHAVIORS IN THE SCHOOLS 

The school is a social environment in which the behavior of its members 
conditions, as v '>ll as reflects, what is valued and whf.t is permissible in that 
environment. Rutter and his colleagues point out that norms and values can be 
established in a variety of ways. The chief mechanisms in schools are likely to be: (i) 
teachers' expectations about the children's work and behavior, (ii) the models 
provided by the teachers' own conduct in school, and by the behavior of other pupils, 
and (iii) the feedback that the children receive on what Is acceptable perfomiance at 
the school (Rutter ef a/., 1979). The present study examined all of these mechanisms, 
from the students' point of view and the teachers' point of view as indicated on 
questionnaires, but also through repeated informal observations n.ade by university 
participants in the study during the course of site visits. In this chapter, the focus will 
be on models of student behavior, as reported by both .students and teachers. 

Direct or Indirect Teaching of Values 

'Early adolescence offers a superb opportunity to learn values, skills, and a 
sense of social responsibility important for citizen&nip in the United States,' as the 
Carnegie Task Force on Early Adolescence (1989) underscores in its recent report. 
Educators agree that their mission includes teaching values for citizenship. Official 
statements from school systems about their philosophy or mission often name 
important values which they seek to develop: regard for human worth and dignity, 
respect for the rights and property of others, tolerance and appreciation of human 
diversity, honesty, cooperation, social justice. 

More and more educators seek to influence these values directly. Several 
ncted educators have developed materials and approaches to accomplish this. Ryan 
and Ellenwood (1988) have developed one cumculum whidi incorporates classic and 
contemporary works of literature to help students address important issues and 
confront conflicts which require value judgements; they have also contributed in the 
development of a second cun'iculum about relationships called 'Loving Well' (1989). 
Slavin has been long been a leader in the field of cooperative learning (1980, 1988). 
Wynne and Walberg (1985) offer guidance on school policies that encoaage 
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character development and schoiarship. Recommending extracurricular 'Carnegie 
units.' the Carnegie Task Force advocates >outh service-supen/ised activity helping 
others in the community or in school-as a requirement in the core instructional 
prog'-ams of all middle schools (1989). 

Whether or not schools choose to influencr* values directly, there is ample 
evidence that the teadiing of values comes witli the territory. In her comprehensive 
review of research on school climate, Anderson (1982) cites numerous studies 
attesting to the effect of school dimate on many student outcomes, including cognitive 
and affective behavior (Barker, 1963; Brookover et aL. 1978; Duke & Pen7, 1978; 
Weljer, 1971), kxjt also values (Taba, 1955; Vyskoal & Goens, 1979), and persona! 
growth and satisfaction (Bailey, 1979; Coyne, 1975; Cox, 1978; Vyskocil & Goens. 
1979). 

Student Behaviors as an Index of School Climate 

Taguri's (1968) conceptualization of organizational climate is useful for locating 
students' prosodal and antisocial behaviors as an index of school climate. Climate is 
a summary concept which includes the ecology (physical and material aspects), milieu 
(presence of pb.^ons and groups), social system (patterned relationship; among 
persons and groups), and culture (belief systems, values, norms, and meaning 
reflected in behavior). These student behaviors are both independent variables 
shaping the social system of the school and dependent variables reflecting the culture 
of the school. 

The student and the teacher questionnaires used in the present study contained 
parallel sets of items requesting estimates of the frequency of prosodal and antisodal 
behaviors exhibited by students in their schools. Percentages of students who choose 
each catego v on a five-point scale of frequency are given in Appendix B for students' 
estimates of the frequency of prosocial a'^'^ antisocial behaviors respectively. 
Comparable data summarizing the teachers' vantage poi=it on students' prosodal and 
antisocial behaviors are given in Appendix A. 

There are a few items in each questionnaire which are not in the student or 
teacher counterpart. The items from the teacher questionnaire on showing 
appreciation of teachers and shov«^ing interest in learning were not induded on the 
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student questionnaire. The items from the student questionnaire on helping other 
students with personal problems and helping students who don't speak English talk to 
others had no parallel on the teacher questionnaire. Of the antisocial behaviors, the 
items from the teacher questionnaire on sex offenses, and impertinence and 
discourtesy to teachers did not appear on the student questionnaire. Finally, the item 
from the student questionnaire on teasing students who get good grades had no 
counterpart on the teacher questionnaire. 

The pro and antisocial behavior items for the teacher questionnaire were 
developed first. Since readability was not an issue for these educated adults, 
revisions were not necessary. However, the student questionnaire unden^^ent several 
pilot tests to improve the level of understanding of the items by the students, many of 
whrnri had reading difficulties. Research associates in the field asked the students to 
tell them which items or words they couldn't understand. Items given various 
interpretations were split into separate items, and simpler words were chosen to 
convey our intent. Thus, fcr example, bad-mouthing and bullying became separate 
items on the student questionnaire, and 'racial incidents' from the teacher 
questionnaire became 'make racial insults' for the student version, arguably changing 
the referent. The teacher questionnaire was not readjusted to reflect the change: in 
the student questionnaire. To aid the readers review of the comp&iisons, parallel 
items from the student and the teacher questionnaire are presented next to each ether 
in Table 9.1 for the prosodal behaviors and Table 9.2 for the antisocial behaviors. The 
means are given for teachers' versus students' responses on their respective items. 

Inspection of tlie means in Table 9.1 reveals that students and teachers are 
generally consistent in their estimates of the frequency of specific prosocial behaviors 
which students exhibit in school. There are only four comparisons on which teachers 
and shxients differ by more than two-terrths of a scale point. Three of these differences 
may be atbibutable to lack of parallelism in the items and one to a real difference in 
perception. Students' 'helping out at school' on the student form in contrast with 
'volunteering' as expressed on the teacher questionnaire showed teachers' estimates 
give a more positive view than students' report for themselves by a difference of 
almost seven-tenths of a point on a five point scale. Volunteering is arguably the 
broader referent, which teachers interpreted to mean offering answers in class as well 
as more substantial behaviors. Similarly, 'student involvement in decision making" 
from the teacher questionnaire may be a broader notion than "help make class oiles" 
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TABLE 9.1 

Summary of Mean Differences Between Students' and Teachers' 
Perceptions of the Frequency of Students' Prosodal Behaviors 



!tem#/ Actual Wording of Items for X3 Xt Xs-Xt 

c> orT Students versus Teachers 



36 A/S Help out at school 3.03 -.69 

21 A/T Student volunteering 3.72 

36B/S Help plan school activities 2.80 .19 

36 J/S Help make class rules 2.32 - 29 

2 1 B/T Student involvement in decision making 2.61 

36C/S Take care of school property 2.64 -.16 

21 C/T Taking care of schod property 2.80 

36 D/S Get along virlth each other 3.47 .34 

21 D/T Tolerating others 3.13 

36 E/S Make friends virith students of other 3.77 .13 

racial/ethnic groups 

36 M/S Make friends virith students virho are 3.74 .10 

new to the school 

2 1 E/T Making Mendships across radal and 3 . 64 

ethnic groips 

36 F/S Show respect for teachers 3.40 32 

21 F/T Shovifhg respect for teachers 3,08 

36 G/S Help other students learn 3.06 -19 

21 l/T Helping other students learn 3.25 

36H/S Get into school activities and clubs 3.13 - 20 

21 J/T PartidpaUng in extracurricular activities 3.33 
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TABLE 9.2 



Summary of Mean Differences Between Students' and Teachers' 
Perceptions of the Frequency of Students' Antisocial Behaviors 



item #/ 
SorT 


Actual Wording of Items for 
Students versus Teachers 


"Xs 


"Xt 


Xs-Xt 


37 A/S 
22A/T 


Steal things from others 
Stealing 


2.71 


3.05 


-.34 


37B/S 
37 C/S 

22 en- 


Destroy school property 
Write graffiti (write on walls) 
Destruction of school property 


2.97 
3.17 


3.37 


-.40 
-.20 


37 D/S 
37 E/S 
22E/T 


Bad-mouth other students 

Bully other students 

Meanness and txjilying t)etween students 


3.69 
3.28 


3.59 


.10 
-.31 


37 F/S 
72? IT 


Fight with other students 

Fighting 


3.53 


3.38 


.15 


37G/S 


Make racial insults 


3.09 




.73 


22G/T 


Racial Incidents 




2.36 




38 A/S 
38B/S 
22H/T 


Cut class 
Cut school 
Tmancy 


2.84 
2.73 


3.42 


-.58 
-.69 


38 C/S 
221/r 


Hit teachers 

Physical violence against teachers 


1.82 


2.43 


-.61 


38 D/S 
22^ 


Swear or use dirty words 
Using profane or obscene language 


3.56 


3.88 


-.32 


38 E/S 
22K/T 


Use illegal drugs 

Using illegal drugs 


1.72 


2.20 


-.48 


38 F/S 


Drink alcohol 

Drinkinn alcohol 

k^l II IrKII rW ClfwWf /Wf 


1.73 


1.90 


-.17 


38 HIS 
22 WT 


Cheat on tests 

Cheating on tests 


2.84 


2.98 


-.14 


38 l/S 
22N/T 


Disturb class 

Creating dassroom disorder or chaos 


3.37 


3.31 


.06 


38 J/S 
22 0/T 


Smoke in school 

Smoking in school 


1.99 


1.95 


.04 
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as expressed on the student questionnaire. Nonetheless, it is inrportant to note that 
students reported the highest percentage by far of responses in the category of 'never 
happens* (41%) for helping to make dass njles than for any other activity. Teachers 
who want more share in decision making for themselves may consider appropriate 
ways to empower their students-and hold them accountable-as a way of changing 
the climate of the school for the better. 

Students reported higher rates of 'getting along with others' than teachers 
reported 'tolerating others,' but again the item revision on the student version 
produced non parallel items. Students' 'showing respect for teachers' was worded 
identically on both the teachers' and the students' versions; still their mean response 
to this item differed by .32. It appears that students think they are more respectful of 
the teachers than the teachers think they are. 

Prosocial behaviors for which students reported high frequencies (greater than 
3.50) included making friends with students of other racial/ethnic groups, and making 
friends with students who &re new to the school. Teachers also reported high 
frequencies for students' making friendships across racial and ethnic groups. (One 
remarked: 'Big deal! This school has been been integrateo for more than twenty 
years.') 

A review of the means in Table 9.2 suggests that teachers generally estimated a 
higher frequency of antisocial behaviors than students did on the same Items. The 
notable exception, where teachers reported a much lower frequency, occurred for the 
item on racial incidents. Again the stronger wording on the teachers questionnaires 
(racial 'incident' versus racial 'insults' on the student questionnaire) could account for 
the difference as much as the difference in perspectives. The item 'cheating on tests' 
produced roughly s;, .nmetrical distributions for both the students' and teachers' 
version, but the teachers' distribution was highly peaked with very few responses in 
the extreme categories, whereas the students' distribution was more rectangular, 
reflecting frequency estimates across the whole range, from 'never happens' to 
'happens a lot'. 

The teacher questionnaire allowed space for examples the prosocial and 
antisocial behaviors. Some teachers were not inclined to take the time to respond wi^ 
specific examples, but others wrote extensively. One example which gave a much 
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dearer perspective to what might be considered a sex offense in a middle school 
(where no rapes or attennpted rapes have been reported) is 'inappropriate touching/ 
Other examples which gave dearer definition to the indices of prosodal and antisocial 
behaviors are induded in Appendix A. 3. 

Factor Analysis of the Student Data 

Because the data base for student responses was so large, we were able to use 
factor analysis to investigate whether a smaller number of underlying constructs might 
explain what the original, larger group of items represent. Since the probability of 
statistical significance is in part a function of ttie number of tests performed, it was 
preferable to reduce ttie number of variables, and not inflate tiie probability of finding 
differences which are simply attaibutade to chance. Principal components factor 
analysis of all 14 items of prosodal behaviors combined witti all 18 items of antisodal 
behaviors from the student questionnaire produced six factors with eigenvalues 
greater tiian 1.0. Together they accounted for 60.8% of the variance in the original 
data. This analysis was fdlowed by verimax rotation. 

Two factors of antisocial behaviors emerged folic •ved by four factors of 
prosodal behaviors. They were named as follows: 

1. Antisodal-Lesser Infractions 

2. Antisodal-Major Transgressions 

3. Prosodal-Helping Ottiers Directiy 

4. Prosociai-Helping with Tasks 

5. Prosodal-Friendship and Harmony 

6. Prosocial-Showing Respect 

The six factors were very 'clean' in tiiat ttie items weighted on each factor with 
loading usually in excess of ,60, or not at all, i.e., dose to .00. Very few items loaded 
on factors with weights of .2, .3, or .4. Therefore, .50 was used as tiie cut off to indude 
or exdude items on a factor. The results are sunrvTiarized in Table 9.3. induding the 
items contributing to each factor, tiie range of possible values, the midpoint on tiia 
scale, and the mean for all students. Factor scores were created by adding students' 
responses on tiie items contributing to each factor. These six factor scores were used 
as the dependent variables in 4-way analyses of variance to investigate student 
differences by school, grade, gender, and race. 
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TABLE 9.3 



Results of Factor Analysis of 32 Prosodal and Antisodal Behavior 
Items from the Student Questionnaire 



Factor Numt>er & Name Eigen- 
value 


Pet of 
Var 


Cum 
Pet 


r of 
Iteiiis 


Range 


Mid- 
point 


Mean 


1: Lesser Infractions 10.07 


31.5 


31 .0 


14 


14-70 


AO 


A'i RO 


2: Major Transgressions 4.35 


13.6 


45.1 


4 


4-20 


12 


7.20 


3: Help Others Directly 1.56 


4.9 


50.0 


6 


6-30 


18 


Mil 


4. Help with Tasks 1.28 


4.0 


54.0 


4 


4-20 


12 


11.95 


5. Friendship/Hannony 1.14 


3.6 


57.5 


2 


2-10 


6 


7.19 


6. Show Respect 1.05 


3.3 


60.8 


2 


2-10 


6 


5.99 



'Only those items with factor weights > .50 were used to create hictor scores on a given fuctor. 



Differences in Students' Perceptions of Their Peers' Behaviors 

The very large data b?^e for responses to the student questionnaire (n>1583) 
permitted statistical analyses which were not appropriate for the teacher questionnaire 
(n»92). Only one-way ANOVA's by school were used to analyze the teachers' 
estimates of the frequency of prosocial and antisocial student behaviors. But four-way 
analysis of variance of the student responses enabled us to examine differences in 
student behaviors which might be a function of the sodnl system and culture of the 
school versus a function of milieu, i.e., the characteristics of persons and groups who 
are present within the school environment. The ANOVA's of behavior variables by 
school, grade, sex, and race ene'^led some sorting of possible causes in the 
accounting for differences. 

This capability was important to the study because school dimate research is 
plagued by tiie phenomenelogical debate over the validity of perceptions as measures 
of climate. As Anderson (1982) noted, data gathered from individual perceptions are 
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flawed because perception depends on individual differences as well as 
organizational differences. It has been shown that perceptual data from students differ 
by sex. grade, and socioeconomic level, among c/Hner factors (Herr, 1965). It has also 
been argued that peoples' perceptions are conditioned by previous experiences, 
needs, and values (Bloom, 1976; Davis, 1963; Hellriegel & Slocum, 1974; Mitchell, 
1967). 

Results of the four-way analyses o. variance ate summarized in Table 9.4. 
Results will be considered first for those independent «/ariables which are inherently 
non-manipulabie-gender and race, and grade to the extent it is a function of age. 
Differences by school, the alterable variable, will be discussed last. 

Differences by Gender 

Females in all four schools were far more likely than males to report that 
antisocial behaviors of 'lesser infractions' (Factor 1) occur (p<.OOOI). Females may be 
more sensitive to ttie occurrence of 'stealing, cheating, bullying' in ttieir midst. Their 
reports on ttie frequency of serious ti-ansgressions (Factor 2), including hitting teachers 
and using alcohol and drugs in school, were not significantiy different from male 
students. 

As far as prosodal behaviors were concerned, females were significantiy more 
likeiy to report helping others directiy (Factor 3, p<.0001), and helping with tasks 
(Factor 4, p<.OOOI). 'tTiere was no significant difference in ttie extent to which males 
and females reported 'getting along with ottiers' or racial harmony (Factor 5), but on 
Factor 6, showing respect for teachers and property, males again scored lower tiian 
females (p<.05), suggesting that males have different standards for tiiese behaviors, 
and/or ttiat females are more sensitive to infractions of socially acceptable norms for 
behavior. Stereotypes of feminine behavior are oftentimes negative, but tiie sex 
differences in perceptions of student t>ehaviors found in the present study look like 
positive ones favoring females. 

Differences by Race 

Race was a significant factor in the analyses of variance of all tiie pro and 
anti'sodal behavior factors except one, ttie perception of general and especially racial 
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TABLE 9.4 



Summary of SignificarTt F Ratios from Four-Way Anrlyses of Variance of Student Factor 
Scores on Prosodal and Antisoctai Behaviors, and Results of Duncan Tests of the 
Significance of Mean Differences for Main Effects: School, Grade, Sex and Race 



Degrees of Freedom 


A 

School a 
3 


R 

Grade 
2 


c 

Sex 

1 


D 

Raceb 
4 


AXC<= 
3 


AXDc 
12 


1. Lesser 
Infractions 


12.01"" 
2<4<1.3 


3.83* 
6<7,8 


12.35**" 
M<F 


14.77**** 
A«OHBW 


4.85** 
M<F. all 
but Sch 4 


NS 


2. Major Trans- 
gressions 


17.72"" 
2<4<1,3 


4.07* 
6<7,8 


NS 
M<F 


6.40**** 

A<OHBW 


6.19**" 
M<F, all 
but Sch 4 


NS 


3. Help Others 
Directly 


3.00* 
3<2,1,4 


18.68**** 

8,7<6 


23.06**** 
M«F 


10.62"" 
WOB<AH 


NS 


2.95" 


4. Help with 
Tasks 


NS 


13.70*" 
7,8<6 


13.79"* 
M<F 


3.15* 
W<H 


NS 


NS 


5. Friendsliip/ 
Harmony 


328* 
2.K4 


5.56** 
8<7,6 


NS 


NS 


NS 


1.95* 


6. Show Respect 


5.75*** 
3,1<4,2 


28.14*"* 
8<7<6 


5.30* 
M<F 


7.04**** 

OWHB«A 


NS 


1.86' 



aConsistent with the text, schools are coded School 1, School 2, School 3. and 
Sdiool 4 in the report of Duncan tests. 



b Race/ethnicity is coded A=Asian, B=black, H=Hispanic, W=white, and Oother 
in the report of Duncan tests. 

cNo other interaction effects were significant. 



*p < .05 
**p < .01 
***p < .001 
***'p < .0001 
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harmony among students. All five racial/ethnic groups fell very close to the overall 
mean of 7.1S, fully one scale point above the midpoint on this scale. This perception is 
corroborated by the teacher data as well as by continuing discussion and obsen/ation 
in these schooK. There indeed does appear to be a positive level of racial hannony In 
the four schools in which blacks and Hispanics are the oveoA^helming majority. 

Differences according to race were pronounced on both factors of antisocial 
behaviors. In each case Asians reported substantially lower instances of these 
negative behaviors than any of the other radal/ethnic groups. On Factor 1 (for lesser 
infractions), Asians averaged ten or more points below the other groups on the 14-item 
scale whose range is 56 points. On Factor 2 (for serious transgressions), Aians were 
two or more points below the other groups on the four-item scale with a range of 1 6 
points. Both efiects were significant at p < .0001 . It may be that the Asians deliberately 
choose to ignore negative behaviors, prefening to 'See no evil, hear no evil.' But 
other interpretation;, are also possible. The Asians, who 'tend to keep to themselves,' 
may not be present w <)r the negative behaviors occur and/or they may be focused on 
their own acadei iic wot. r>ot 'looking for trouble.' All of these interpretations have 
aedibility with obsen/ers ai^t adult participants in the study. 

Another highly significant difference (p < .0001) according to race occurred in 
the analysis of Factor 3, the prosodal scale for 'Helping Others Directly.' Asians and 
espeaally Hispanics reported significantly higher instances of the positive behaviors 
than the blacks and 'others.' The difference was even greater between the Hispanics 
and Asians on the one hand, and the whites, who scored lowest. If the assumption 
that Halpin and Oroft (1963) made in their original research is valid for the use of 
findings about school di.nate, we can assume that the actual, objective behavior is 
less important than the perceived behavior, because it is the latter that controls the 
individual's response. This would suggest that the Hispanic and Asian students are 
more inclined to help others and in fact do so. 

Hispanics again scored highest in reporting helping with tasks. This time the 
d'fference was not so pronounced, the F ratio being significant at p < .05. The test of 
differences among means showed that the significant difference occun-ed between the 
Hispanics, who ver*^ the highest, and the whites who were the lowest, on Factor 4. 
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On the final factor, a measure of show^g respect. Asians scored significantly 
higher than all other racial/ethnic j^iO«»ps. The difference was highly significant, at p < 
.0001. and in the expected C ^uion. consistent with this very positive stereotype for 
people from Asian cultures. 

Differences by Grade 

Grade level was significant in the analysis of every one of the six factor scores. 
Sixth graders reported significantly fewer antisocial behaviors of both a lesser and 
more serious nature than the seventh and eighth graders. Eighth graders reported 
higher rates of antisocial behaviors than seventh graders, but not significantly so. 

Sixth graders were substantially more likely to report higher frequencies of 
helping others directly. Their scores on Factor 3 averaged more than 1 .5 scale points 
over the seventh and eighth graders. The sixth graders were also more likely to 
report higher frequencies of helping with tasks (Factor 4). by a full scale point on 
average. The differences according to grade leve! for both of these prosocial 
behaviors were significant at p < .0001 . 

A significant grade difference with p < .01 was obsen/ed for Factor 5. This time 
eighth graders were significantly lower than seventh and sixth graders in their 
perceptions of general and racial harmony in their schools. Sixth graders had the 
most positive outlook on this scale, but they were not significantly higher than seventh 
graders. 

As far as showing respect is concerned, eighth graders report significantly lower 
perceptions of these behaviors among fellow students than seventh graders. In turn 
seventh graders scored significantly lower than sixth graders. The effect of grade on 
this variable. Factor 5. was highly significant at p < .0001 . 

While it was not surprising to those who live arxj work with middle school youth, 
it is non3theless troubling that studants in the higher grades perceive more antisocial 
behaviors and fewer prosocial behaviors than sixth graders, whose outlook appears to 
be more positive. If perception does indeea condition behavior, then schools need to 
target interventions which will halt the decline in students' positive outlook which 
oa urs between the sixth and seventh grade. There are important changes which 
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occur in the populations served by the four schools in our sample. In most cases the 
students who are highest achieving academically transfer to one of the more 
prestigious 'examination schools/ This exodus is more pronounced in Schools 2 and 
4, but if the schools ware affecting the students differentially by grade, the differences 
ought to produce significant school by grade interaction effects. They don't. None is 
statistically significant, as seen in the fifth column of Table 9.4. 

Differences by School 

Happily there were also significant differences in the students' perceptions of 
prosodal and antisocial behaviors according to school, suggesting that schools can 
shape their environmer.es to foster more positive norms and standards among 
students, even if some differences in perception are a function of unalterable 
variables-sex, race, and age. School was ^ significant effect in the analysis of all the 
pro and antisocial behavior factors but one, iielping with tasks. 

There were highly significant differences (p < .0001) among schools on ttie two 
factors for antisocial behaviors. Analysis of mean differences among schools on the 
factor of lesser infractions showed that School 2 was significarrtiy lower than the ottier 
ttiree schools and that School 4 in turn was significantly lower than Schools 1 and 3. 
The fame pattem of significant differences among means occun-ed for the factor on 
more serious transgressions. These differences among schools in the perceptions 
reported by stijdents correspond with the observations made by the Univfirsity-based 
members of tiie research team who have visited these schools on a regular basis. 
That School 2 was significantly lower tiian the otiier high achieving schooi. School 4. 
is particulariy noteworthy. School 2 was run like a marine drill cannn. StiJdents filed 
ttirough ttie halls in sta^aight lines or else. School 4 had a more invidng atmosphere, 
still orderiy, but with an ethic of caring. This is the first of several indications in this 
rei3arch that the two higher achieving schools are decidedly different in their 
climates. Repeated visits to tiie school pointed to tiiis difference oariy on; indeed, the 
difference was palpable. The quantitative data from students certainly helped to 
explain tiiis qualitative finding. 

The higher frequency of negative behaviors in Schools 1 and 3 was also 
corroborated by infomial observational data during site visits. Interestingly. School 1 
was ttie largest and School tiie smallest, with 1989 enrollments of approximately 
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700 and 250 students, respectively. But neither of these schools felt orderly. 
Students' arrival and departure from school as well as the change of classes and 
lunch periods were far less orderly than in Schools 2 and 4, whose students appeared 
to be calmer and more focused on learning. Size might account in part for the higher 
rates of antisodal behaviors reported for School 1. The University-based project 
coordinator who became a member of School 1's 'Action Team' likened the school's 
environment to "popping pop com.' There are so many students bopping into each 
other, skipping through the halls, excited, and full of energy. They're not necessarily 
misbehavlr^'], but the environment in their presence is charged.' 

If size alone were a factor in the differences among schools in antisocial 
behaviors, and clearly it is not. School 3 would score lowest on these negative 
outcomes. One reason which might explain why it scores higher on reports of 
antisocial behaviors is that unlike the othr: three schools and especially Schools 2 
and 4, School 3 is a 'walking school' as opposed to a 'bussing school.' Located in 
one of the poorest sections of Boston, it serves students many of whom live in the 
immediate nrighborhood, and events in their lives which occur outside of school take 
over^me social dynamics in the school. 

An incident which occun-ed moments before a visit to School 3 by the principal 
investigator and the project coordinator might illustrats this point. School had just 
been dismissed, and a fight had occun-ed on school grounds. Reportedly five middle- 
school aged boys were beating up a girl the same age. Two teachers from School 3 
broke up the fight; the principal ran out to escort the girl back into the building, caii her 
rrother, and have her taken home. When we an-ived, the principal greeted us warmly, 
teiiiphone in hand, and apologized that she also had to call the nun who was the 
principj^^of the parochial school a block away. None of the attackers were students at 
School 3; they all attended "St. Patrick's" (an alias for the parochial school). 

Good schools must have safe orderly environments, but this cannot be 
achieved at the expense of running a school like a prison. Doing so would counter a 
number of needs expressed by the students themselves for which they would like to 
get help in ichool. In another chapter of this report, it was noted th::t students in 
Schools 1 and especially those in School 3 place significantly higher priority on 
nonacademic services from the school. Their responses reflect a need for nurturing 
and a desire for counseling on a host of issues. One member of the research team 
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who had visited School 3 many times returned to the University after an assembly. 
Seeing all the students together she remarked: 'They look like little street people. 
Students in the other schools are poor, but not like this/ 

On the prosodal behavior factor for helping others directly, students in School 3 
reported significantly lower frequencies than students in the other three schools. The 
difference was significant at p < .05. In light of the foregoing, it may be that the 
students in School 3 need more caring and nurturing, and their lower scores reflect 
that deficit, as well as actual lower frequencies in instances of helping others. 

On the factor called radal/general hamrK)ny, whi':h included the items on getting 
along with each other and making friendships across radal/ethnic groups, students in 
Schools 2 and 1 repoi^tad significantly lower frequencies of thesv^ behaviors than 
students in School 4. It is especially noteworthy that this factor separated the two 
academically higher achieving schcols. School 2 from School 4. (The latter was 
highest overall.) It would appear that the very rigid codes of behavior that promoted 
'law and order' in School 2 dkj so at a price. While there were significantly lower 
reports of antisocial behaviors in School 2, there was a lower perception of harmony 
and friendship in the school's environment. Again, informal observations on a great 
marry occasions confirm this difference. 

As far IS showing resrject is concerned, students in Schools 3 and 1 report 
significantly lower perceptions of this kind of behavior than students in Schools 4 and 
2. Not coinddentally, this split parallels exactly the division between the two schools 
in academic achievement measures. 

Interaction Effects 

Out of 36 possible first-order interaction effects, only six were statistically 
significant, three of these only at the .05 level. By chance, two would be significant at 
that level. No higher order interaction effects were signtficartt. Since the sample size 
was very large, and even small differences could be statistically significant, only those 
meeting more stringent probability levels are reported here. 
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School by Sex 



Two school by sex Interaction effects were significant, one at p < .01 , and the 
other at p < .0001 . Both differences concerned antisocial behaviors, the first for lesser 
infractions, the second for more serious transgressions. On both of these measures, 
females at School 4 reported lower instances of the antisocial behaviors than did 
males at their school. In all other schools, females reported higher frequencies on 
average than the males. Earlier, in the discussion of the highly significant main effect 
for sex differences in which females reported significantly higher rates of the lesser 
infractions, it was suggested that females may be more offended by such behaviors 
and more sensitive to their occurrence. But this interaction effe^ also suggests that 
the presence of females in the environment may affect what behaviors take place in 
their midst. The only school in the sample in which females outnumbered males was 
School 4. Females constituted 47% of School 1, 41% of School 2, and 43% of School 
3. but 52% of School 4. If this is so, the implication for schools wanting to aeate a 
safer, more orderly environment is to recruit girls. 

School by Race 

Analysis of the factor on helping others directly produced a highly significant 
interaction ef.'ect for school by race, at p < .0001. All ethnic groups reported higher 
rates of helping others direclty at School 4. But for other schools, groups reported 
helping others more only where they constituted a majority or a sizable minority in their 
school. Thus, Hispanics reported high rates of helping others only at School 1 , and 
those in the racial category called 'other' (which includes Native Americans) report 
high rates of helping at School 3. This group at School 3 included several students 
who were combination black and American Indian, as was their new principal. 

How Teachers View Their Students' Behaviors: Differences by School 

The number of usabia teacher questionnaires was only 92 (after 10 in School 2 
which copied and distributed an earlier form had to be deleted), and 25 items were 
included for their assessment of students' prosodal and antisocial behaviors. Factor 
analysis of all 32 prosocial and antisocial behavior items combined was appropriate 
for the student data base which numbered 1583, and six clear factors emerged. 
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However, even by separating the teacher items into two groups of 11 prosocial 
behaviors, and 14 antisocial behaviors, to enable a higher ratio of respondents to 
items in separate factor analyses, it was not possible to approach the ideal of 10 to 1 
respondents per item. It was decided to use the teachers' item responses rather than 
factor scores as the dependent variables in the analysis of school differences. 

One-way analyses of variance were used to investigate differences in teacher 
perceptions of their students' behaviors among schools. Results of these analyses for 
antisocial behaviors are summarized in Table 9.5. Significant differences in teacher 
perceptions among schools were found for only one prosocial t)ehavlor. Teachers in 
School 4 reported significantly higher rates of students' taking care of their school's 
property than did teachers in Schools 1 , 2, and 3. The F ratio of 3.54 was significant at 
p<.01. 

Analyses of the antisocial behaviors produced several significant differences at 
p < .05 or beyond. Two additional differences which approach significance at .06 or 
.07 are also reported, because the trend of differences is very consistent, even in this 
small sample. Teachers in School 4 report significantly lower rates of student 
destnjction of school property than teachers in Schools 1 and 3 (p < .01 ). Teachers in 
School 4 also report fewer instances of sex offences by students than teachers in 
School 3 (p < .06). Regarding impertinence and discourtesy to teachers, again 
teachers in School 4 reported less of this kind of behavior in contrast to teachers in 
School 1 (p < .07). Teachers in School 4 said there was less meanness and bullying 
among their students than teachers in both Schools 1 and 3 (p < .05). As far as 
fighting among students was concerned, again teachers in School 4 saw less of this 
behavior than teachers in School 1 and 3 (p < .01). The item on truancy yielded the 
same result; teachers in School 4 were significantly Icwer in their reports of truancy 
among their students than teachers in Schools 1 and 3 (p < .01). 

For the second half of the teacher items on antisocial behaviors, the pattern 
continued, with teachers in School 4 reporting lowe' frequencies of negative 
behaviors; sometimes they are joined by teachers in School 2 at the lower end of the 
scale, sometimes their responses contrast significantly with only one school, 
sometimes two, sometimes all three. But each time, teachers in School 4 report the 
more positive view of their students' behaviors in school. Teachers in Schools 2 and 4 
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TABLE 9.5 



Summary of Significant F Ratios from One-Way Analyses of Variance of Teacher 
Perceptions of Their Students' Antisocial Behaviors, and Results of Duncan 
Tests of the Significance of Mean Differences Among Schools 



Item on Teacher Questionnaire Significant F DuncanTest^ 



A. 


Stealing 


N.S. 




B. 


Destruction of school property 


4.77" 


4<1.1 


C. 


Sex offenses 


2.39+ 


4<3 


D. 


Impertinence and discourtesy to teachers 


2.38+ 


4<3 


E. 


Meanness and tMJilying t>etween students 


3.05* 


4<1.3 


F. 


Fighting 


4.56" 


4<1.3 


G. 


Racial irx;idents 


N.S. 




H. 


Truancy 


4.10" 


4<1,3 


1. 


Physical violence against teachers 


3.79" 


2.4<3.1 


J. 


Using profane or obscene language 


3.05* 


4<1 


K. 


Using illegal drugs 


N.S. 




L. 


Drinking alcohol 


N.S. 




M. 


Cheating on tests 


N.S. 




N. 


Creating classroom disorder or chaos 


6.54*** 


4<1.2.3 


0. 


Smoking In school 


3.22* 


2.4<1.3 



aAs in the text, schools are coded School 1 . School 2. School 3, and School 4. 

+p<.07 

* p<.05 
** p<.01 
***p<.001 
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reported significantly less physical violence against teachers than teachers in 
Schools 3 and 1. As far as using profane or obscene language was concerned, 
Teachers in School 4 reportfKj significantly less of this among their students than 
teachers in School 1 (p < .05). Teachers in School 4 reported significantly lower rates 
of their students' creating classroom disorder or chaos than all of the other three 
schools, including School 2 . The difference was very significant at p < .001 . Analysis 
of mean differences on the item for Sinoking in school placed Schools 2 and 4 
significantly lower in teacher reports of this behavior than School 1 and 3. 

Finally, it is interesting to note those iterrw which teachers chose to leave blank. 
(They were advised at the outset that they should feel free to omit responses to Items 
which they felt might threaten or incriminate them, even though the instrument was 
given anonymously). Fifteen teachers omitted reports on the frequency of sex 
offenses; 7 on the item of racial incidents; 17 on using illegal drugs; 19 on drinking 
alcohol; 9 on cheating, and 14 on smoking in school. Not surprisingly, most of these 
items with large numbers of missing responses did not yield significant differences 
among schools. What these items appear to have in common in contrast to the other 
antisocial behaviors Is that the former group of items include behaviors which the 
teacher might be expected to prevent (cheating) as opposed to unlawful behaviors 
which they should report to authorities including racial incidents, sex offenses, using 
illegal drugs, drinking alcohol, smoking in school. Using bad language or disrupting 
dass pale by comparison In terms of their severity. 

Summary and Discussion 

Students' prosodal and antisocial behaviors were used as an index of school 
dimate. These behaviors shape the sodal system of the school and reflect its culture, 
induding its values and norms for permissible behavior. To assess these behaviors, 
parallel sets of items were used in the student and teacher questionnaires requesting 
their estimates of the frequency of prosocial and antisodal behaviors exhibited by 
students in their schools. These perceptual data were used as direct indicators of 
normativ i climate for each school. Obsen/ations during site visits by University-based 
members of the research team were used to corroborate the perceptual data from 
student and teacher groups. 
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Consistency of Students' and Teachers' Perceptions 

Students and teachers were generally consistent In their assessments of 
students' prosocial behaviors In the schools. Differences which occun-ed could be 
attiibuted to differences In the wording of the items, after changes were made In the 
student questionnaire to simplify the reading level. One difference between 
perceptions of students versus teachers occurred on Identically worded items- 
students reported that they showed more respect for teachers than the teachers 
thought they did. Teachers were consisterrtly more negative In their assessments of 
their students' antisocial behavior: students did not see themselves in such an 
unfavorat>le light. 

Results of previous studies about the consistency of perception of school 
climate among groups of respondents have been mixed. Some researchers have 
found that students, teachers, and adminisb-ators differ among ttiemselves, but within 
one group are consistent (Ellet et al., 1977, Ellet i Walberg, 1979). Otiier researchers 
report that stijdent and teachrr measures are associated with more objective 
measures of school climate, indicating tiiat both groups perceive the school's climate 
in the same way (Davis, 1963; Perkins, 1976). Results from the present study suggest 
that both findings may be valid; it depends on the target of the perception, and 
precisely how the perception is measured. Tea'tiers and students were similar in their 
assessment o* most prosocial behaviors. They were somewhat more discrepant in 
how they rated antisodal behaviors; most likely, teachers were more sensitive to. 
more offended by, and/or more threatened by, their students' antisocial behaviors than 
the students were by their own peers' behavior. 

Perceptions as a Function of Individual's Atblbutes 

Previous studies on perception of dimate also suggest that variance may be a 
function of individual differences as well as organizational differences (Hoover, 1978; 
Moos, 1979). If Hen- (1965) was con-ect, people yfAW generalize from their own 
experience and environmental press, and differ in ttieir perceptions according to sex, 
race, SES, age, and grade. These are largely unalterable variables. The present 
study examined students' perceptions of behaviors witii a four-way ANOVA design 
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which enable investigation of effects by sex, race, grade, but also school. These 
analyses produced a host of statistically significant results. 

Three gender differences were highly significant at p < .0001 . One of these 
was significant even well beyond that level. By a substantial margin, females were far 
more likely than males to report that students in their schools engaged in behaviors 
which involved helping others directly. Also by a substantial margin they were more 
likely than males to report helping with tasks, probably because the females 
themselves engage more frequently in the helping behaviors. The females were also 
significantiy more likely than males to report antisocial behaviors in their mldtl 
arguably because these behaviors are more objectionable to the females. 

Four differences attributable to race/ethnidty were highly significant at p<.0001. 
Three of these separated the Asians from all other radal/ethic groups. Asians were far 
less likely to report antisodai behaviors in their schools, including those which were 
classified as relatively lesser infractions as well as those called major ti-ansgressions. 
It was suggested that Asians may be acculturated to ignore such violations, prefen-ing 
to 'see no evil, hear no evil,' or they may not be present when these negative 
behaviors take place. Several teachers and administrators in the schools have noted 
in conversation and in written remarks on questionnaires that the Asians oftentimes 
'keep to themselves.' Asians were far more likely than all other racial/ethnic groups to 
report showing respect, a finding which is consistent with this positive stereotype for 
Asian cultures. Another highly significant difference by race separated the Hispanic 
and Asians from the others in their reports of helping others directiy. Finally whites 
were less likely than Hispanics to report helping with tasks. 

Grade differences were statistically significant in the analysis of all six factor 
scores. In every case, the sixth graders fell toward the more socially desirable 
position, reporting fewer antisocial behaviors and moie prosocial behaviors taking 
place than seventh and eightii graders. Again, if perception is a valid indicator of 
objective climate, and if climate conditions how people behave, then the sixth graders 
are behaving in more socially desirable ways than students in the next higher grades. 
The grade differences were especially significant for the prosocial behaviors, 
indicating that the younger students probably do have a mora positive outiook and are 
more disposed to act in prosocial ways by helping others, helping with tasks, getting 
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along, making friends, and showing respect. Here is where interventions need to be 
targeted-the sixtti grade- in order to sustain these positive t>ehaviors. 



Epstein, in personal communication, (1990) commented that these findings 
regarding grade differences are especially significant, t>ecause most previous studies 
which point to negative changes between sixth and seventh grades compared 
students who were not in the same schools-sixth graders in K-6 or 4-6 configurations 
of grades, versus seventh graders in junior high schools or 7-12 schools. Even in 
longitudinal studies, there was concern that the school might account for the difference 
as much as the age. The present study conducted in middle schools which include 
grades 6, 7, and 8 suggest that differences can t>e attributable to both grade and 
school (as well ?.s sex and race). 

Differences Attritxitabie to School 

Differences among schools were significant in the analysis of all of the prosocial 
and antisocial behavior factors except one. Highly significant differences in both 
lesser and more serious antisocial behaviors separated the academically higher 
achieving schools (Schools 2 and 4) from the two which were less successful 
academically. Students in the latter two schools (Schools 1 and 3) reported much 
higher frequencies of antisocial behaviors in their midst. But there was another 
significant separation between schools on these variables as well, one which merits 
further attention. While the two high academic schools were significantly lower in 
antiscdal bahaviors than the other two schools, they were significantly different from 
each other as well. The school which ranked second on all achievement measures 
(School 2) when the more appropriate comparisons were made by program (bilingual, 
special education, advanced, etc.) is the school which is lowest by far in antisocial 
behaviors. However, it is also lowest when it comes to the measure of friendship and 
racial/general hannony among students. To the outside observer, this school 
appeared to be run 'like a marine drill camp,' placing too high a priority on law and 
order. Its students were given few social freedoms in school-like single file changes 
of dass with no talking-and this policy may have taken its toll on the prosocial 
behaviors which involve nurturing. 

Significant differences in prosocial behaviors among schools consistently 
favored School 4, the top ranked academically. Its students' means for reported 
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frequencies were always on the positive side of any significant differencas. The other 
schools had mixed results. School 3, the smallest and probably poorest school in 
terms of its students' level of disadvantage, scored significantly lower than Schools 2. 
1. and 4 (ranked from low to high) in the students' perception of the frequencies of 
behaviors which involve helping otha.'s directly. This difference may reflect a serious 
deficit among the students in School 3 as much as objectively higher frequencies of 
helping behaviors in the other schools. 

Students in Schools 2 and 1 were significantly lower than students in School 4 
in their reports of getting along with each other and making friendships across racial 
and ethnic groups. Independent observations also suggested that School 4 was a 
friendlier, more harmonious place to be. It is especially noteworthy that this top 
ranked school academrcaily appeared to strike a balance in achieving an orderly but 
also a friendly environment. On the final measure of prosocial behavior, showing 
respect, students in Schools 3 and 1 reported significantly lower frequencies of such 
behaviors than students in Schools 4 and 2. This highly significant difference favored 
the academically higher achieving schools over the lower achieving schools. 

The Value of School Climate Research 

While there is general agreement among researchers, reviewers, and 
practllioners as to the importance of school climate for school effectiveness, there has 
been disagreement on whether it is worth studying. Critics have contested that school 
dimate is neither measurable (Rutter, et al. 1979; McPartland & Epstein, 1975) nor 
manipulable (Haller & Strike, 1979). Results from the foregoing analyses suggest 
othen/vise. Indicators of prosocial and antisocial student behaviors which were used 
in the present study produced results which were consistent, readily interpretable, and 
cross validated by conversations and formal inten/iews with participant reviewers and 
by independent observations. Most importantiy, the indicators revealed important and 
meaningful differences among schools, as well as genders, racial/ethnic groups and 
grade levels. 

The failure of eariier studies to find significant school effects may have been the 
result of inadequate measurement, too few variables, or the wrong variables. Best 
known of these eariier studies, the Coleman Report (Coleman et al., 1966) inquired 
about who (persons and their attributes like socioeconomic status and race) and what 
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(classrooms, commonroom, special function facilities, k)O0ks, etc.) were in the building, 
rather than how participants used resources or how they related to one another. In 
Rutter's opinion (1980), these were grave omissions of previous studies vAikh 'failed 
to take into account anything about the internal life of a school: its attitudes, values, 
mores or qualities as a social organization. It is just these social, rather than physical 
variables that do account for much of the variation t>etween schools. 

Implications for Practice 

Critics of the value of school climate research considored it a burden to 
policymal<ers who would prefer to know how to manipulate saiod climate to effect 
positive outcomes. As Haller and Strike complained: 'It is undear, for example, who 
(much less how) an administrator or policy-maker might go atx)ut changing an 
organization's dimate' (1979, p. 236). While it was not an experimental study, the 
present study has yielded numerous school differences on dimate variables which 
suggest important implications for practice. 

It would appear from the present study of urban middle schools that high 
achieving schools must have orderly environments unencumbered by antisocial 
behaviors. However tNs is not enough. To maximize potential, the schools should 
also have an ethic of caring, habits of helping others, getting along and making 
friendships across radat and ethnic groups. These prosodat behavia^^ distinguished 
between the first and second ranked schools, the top ranked school appearing to have 
both the necessary and the suffident conditions. The lower achieving schools had 
neither. 

Many schools do know how to maintain law and order, but as Firestone and his 
colleagues (1990) have observed, 'while order and high expectations are important, 
an expanded view of school effectiveness must be taken if we are to serve at-risk 
students well.. ..When a get tough orientation is overemphasized, safety is too often 
purchased at the price of personal freedom and self respect.' 
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CHAPTER 10 



HOW TEACHERS AND PRINCIPALS CONTRIBUTE TO SCHOOL CLIMATE 



At both the classroom and the school level, teachers exert pervasive influence 
on students' behavior. Their influence includes not only motivating students 
academically and promoting their achievement (or failing to do so), but also 
establishing and reinforcing nomis for social behavior as expressed in myriad ways, 
for better or worse, both subtle and blatant. Teachers' influence on dimate is not a 
matter of choice; it comes with the territory. Rutter etaL {'979) concluded that the chief 
mechanisms by which norms and values are established In schools are teacher 
expectations, the models provided by the teachers' own conduct, and the feedback 
which children receive on their perfomnance. Barth (1990) goes so far as to say that 
'the quality and character of a school and the accomplishments of its students have 
more to do with the nature of the adult relationships in a school than with any other 
factor.' 

Newmann (1987), summarizing findings from research conducted by the 
National Center on Effective Secondary Schools, underscores that generating student 
engagement is the central task for schools. 'Unless students put foith serious effort, 
with a commitment to the value of mastering schoolwori^, they are unlikely to learn.' 
Nevmiann and ochers (Ekstrom, Goertz, Pollack, & Rock, 1986; Firestone, 1989; and 
Noddings, 1989) present convindng arguments that the school's succ&ss at this task 
requires substantial attention to the social psychological dimensions, and not just the 
academic dimensions, of school life. 

The social psychological dimensions of schools appear to be particularly 
important for students at risk *or school failure or dropout. The profile of student 
characteristics which predict school failure includes behavior problems, delinquency, 
low skill levels, a history of poor achievement, low socioeconomic status, and minority 
group membership (Ekstrom, et al., 1986). But now these characteristics of individuals 
arf) being examined in combination with characteristics of schools which may 
themselves be partly responsible for students' academic failure. This shift in thinking 
is reflected in the very language used to describe the concept; we no longer speak of 
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students with a 'deficit' or 'disadvantage,' we speak of students 'at risk,' of negative 
consequences of some mismatch between their own arxj the school's characteristics. 



Metz (1983) paints a vivid picture of this mismatch when she describes the 
experiences of minority students in schools as ones that force them to choose between 
the culture with which they come to school and the one presented to them by teachers 
representing the mainstream white culture. These children pull away from the 
teacher's culture and set up strong peer nornris and social ties that support their home 
culture over the teacher's. Students who obsen/e that race and dass are obstacles to 
success see little point in striving for academic achievement, which may only alienate 
the few who can do well in a competitive context. In order to maintain their pride, 
students who are increasingly less capable of competing, proclaim their disdain for the 
academic enterprise. 

Coleman (1987) has argued that students at risk of school failure are the very 
ones who stand to gain the most from the social ''.apital which the school needs to 
provide, since families are no longer well equipped to do so. Such vulnerable 
students may be even more responsive to positive social and educational 
environments than advantaged students whose homes extend the achievement 
orientation of their schools and provide moral and sociai guidance as well. Entwisle et 
al. (1987) documented special gains for black children whose kindergarten 
experience was more influential than that for white diildrejn, and Riehl and Grannis 
(1989) extended the finding of differential gains to the ucademic performance of 
middle school students enroled in dropout prevention programs who were more 
sensilive to their schools' environments. 

Major studies and reviews of school effectiveness literature have acknowledged 
the importance of high expectations and safe, orderiy environments for some time now 
(Edmonds, 1979; Cohen, 1983; Puri<ey & Smith, 1983; Good & Brophy, 1985), but 
recognition of the importance of a caring environment, especially to students at risk, is 
more recent (Firestone, RosenWum & Webb, 1987; Firestone, 1989). In a field study 
of 10 urban high schools, Firestone and Rosenblum (1989) noted that teachers and 
students make a variety of commitments that affect their work, and that these are 
mutually reinforcing: if one is low, it will depress the other. In addition to order and 
high expectations, factors contributing to cydes of commitment included relevance, 
respect and affiliation, administrative support for teachers, consistent and fair treatment 
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of students according to clear njles, and having influence or a sense of control over 
one's work. 

AutonoHiy and discretion in tiie classroom are very important to teachers 
(Cort)ett, Dawson, & Firestone, 1984), and at this level they exert great influence on 
student behavior. As Newinann (1987) argues, 'Student engagement is most directly 
affected k>y the quality oi interaction students have with teache*?. To the extent that 
teachers sVjw high expectation, support, fairness, and sensitivity to students' 
perspectives, students will work.' Bui some of the teachers' influence must be 
orchestrated by the principal, whose role is critical in transforming adversarial 
relationships into cooperative and cdlegial ones (Blum, 1986). As Chub points out: 
'in high-performance schools, decision making is significantly more democratic, 
teachers are more involved and influential in establishing disciplinary cod^is, selecting 
textbooks, designing curricula, and even in choosing their colleagi.es than are 
teachers in low-perfomnance schools.' In high achieving schools, relationships 
between teachers and principals are more cooperative. The principal occupies a 
central position of leadership, engaging in and modeling the positive behaviors we 
want teachers and students to adopt. 

Assessing the Influence of Teachers and Aclministrators on School Climate 

Rewards and punishments constitute public statements about the behaviors 
which soiools wish to encourage or discourage in students. These are communicated 
both at the building level and the classioom level. Norms for behavior are also 
communicated in more subtle, yeii: powerful ways. The teachers' sense of shared 
mission, their regard for students, evidence of collegiality, and control over one's work 
were among the factors assessed in the questionnaire administered to teachers and in 
the semistructured interviews. Principals and other administrators were also queried 
about these issues, their disposition toward sharing power, and the structures and 
schedules which might prorviote cooperative and collegial behaviors among teachers. 
The extent to which students perceived these aspects of behaviors among the adults 
in their midst were also included in several sections of the student's questionnaire. 
Results from all of t^ese soLtrc '^"e addres^Swd in the sections which follow. The 
results are grouped around four ui^mes: commitment to students: respect and 
affiliation among teachers: administrative support for teachers; and loyalty to one's 
school. 
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Commitment to Students 

Student/T eacher Relationships 

Without question, the vast majority of teachers in this sample of urban middle 
schools care atxxjt their students or they wouldn't be there. The first of these powerful 
signals came from the teachers' response to the set of items in section 17 of the 
teacher questionnaire. Asked to rate how important 14 issues are for job satisfaction, 
more than 91% of the teachers chose the highest category of importance for 
teacher/pupil relationships, and the balance choose the next highest point on the 
scale. This item was assigned significantly higher importance than any other item. It 
was also the issue with which teachers expres5ed the highest level of satisfaction. 

While this positiv? response may be reflecting socia! desirability on the teacher 
questionnaire, the intensity and enthusiasm of teachers for their students as revealed 
in the interviews could not have been faked. Even those teachers judged to be 
'burned out' on the job still cared about the students. Asked: "What do you like about 
teaching here?', almost all of the respondents said 'The students!' Only one 
complained of the perception that high schools in the system get more of the 
resources, but even she listed 'the students' as her reason for being there and liking it. 
The followiiig remarks from individual teachers are representative: 

'1 he students keep me arative.' 

'The kids, they are reachable." 

From a totally burned out teacher, nonetheless, 'the age of the kids, the 
enthusiasm of the students.' 
'My students, my kids:' 

'I've had opportunities for administrative posiiions, but that puts me too far from 
the kids. I love the kids.' 

The aches and pains of puberty are everyv^ere.' 

The Kids; they're racially diverse. You either love or hate this age group; no 

one wants it but I love it. You have to be totally fair and consistent.' 

'The students. They're the reason why I'm here. I teli my students. You don't 

work for me, I work for you!' 

'We have great students here.' 
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Conversations with principals echo the same sentiment. On a first meeting with 
one principal in the midst of some chatter, introductions, and small talk when a group 
was assembling as their schedules would permit 'Do you have any children?" "Yes, I 
have 700 hundred!' She was referring, of '^urse. to the schools' student enrollment. 

Shared Responsibility for Student Achievement 

That students' academic achievement and mo.al development are central to 
their professional responsibilities is evident in teachers' assessment of their own jobs. 
Asked to rank what the most important aspect of their job is, 79.5% said "To help 
students leam' was the top priority; and a total of 77.8% ranked teaching values to 
students as first or second in importance. "Taking care of students" (by way of offering 
counseling or social services) was rated a distant third, and 'being a friend to students' 
an even more distant fourth. Asked what their job should be, teachers rated helping 
students learn even more highly, with 86% choosing it as the top ranked responsibility. 
The importance assigned to teaching values remained about the same, but the care 
giving services assumed considerably lower importance in terms of what teachers felt 
their responsibilities should t>e. 

Students cleariy recognize the primacy of the academic mission of the school, 
as evidence by their responses to several items on the student questionnaire. Asked 
to identify the three most important reasons they come to school, students say they are 
there primarily 'to leam" (93%), 'to get a good job in the future" (74%), and 'to get into 
college' (70%). The goal of learning is also underscored in students' assessments of 
the teacher's job as well as their own job in school. The teacher's job is first and 
foremost 'to help us leam' (98.1%), and second 'to teach us rignt from wrong' (51 .5%). 
Students say their own job in school is 'to get an education' (93.9%), and 'to study 
hard' (77.0%). 

What Students Think Teachers Care About 

It is interesting to note that there are no significant differences among schools In 
the students' assessment of what teachers' and students' jobs shou/d entail. Students 
in lower achieving schools report the same pattern of responses as students in the 
higher achieving schools. However, there are important differences in their 
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TABLE 10.1 

Results of Factor Analysis of Student Perceptions of the Ways Their Teachers Promote Learning 



Factor Number & Name Eigen- Pet of Cum 

value Var Pet 



1: Encourage Academic 2.66 29.5 29.5 
Achievement 



2: Promote Competition. 1.37 15.2 44.7 
Inoependence 



Items on the Factor Weight 



A. ToH students to try hard to do batter on tests .73 

D. Tell students to do extra work so that they can .63 

get tMtter grades 

E. Make students work hard to get good grades .70 

F. Try to help students who do badly on their school work .68 
Q. TNnk learning b important .65 

B. TeH students to try to get better grades than their .57 
classmates 

C. Do not care if students get bad grades .53 

H. Altow students to choose what they want to work on .67 

I. Expect students to work on assignments on their own .58 
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perceptions of what their teachers actually do with respect to student achievement. 
Section 39 of the student questionnaire included nine items on what students think 
teachers do to to promote student learning and what practices they use to promote it. 

Sutijected to factor analysis, these items yielded two distinct factors, one on 
how teachers encourage academic achievement, and the second on whether students 
perceive that their teachers promote competition and independence. The items 
contributing to each of these factors and their weights are given in Tal)le 10. 1 . Factor 
scores were calculated for each student by adding their raw scores on the items 
identified for the factor. Then four-way analyses of variance were used to investigate 
differences in students' perceptions by school, by grade, by sex, and by race. 

As reported in TatDie 10.2, there were no significant differences among schools 
in students' perceptions of whether their teachers encourage academic achievement. 
However, all of the other main effects were significant in the analysis of scores on 
Factor 1 . Sixth graders were significantly higher than seventh graders and in turn 
eighth graders in their perceptions that their teachers encourage academic 
achievement. Females reported higher levels of teacher encouragement thm males. 
Asians said their teachers encourage acad^^ic achievement to a significantly higher 
extent than all other radal/ethnic groups, and Hispanics scored significantly higher on 
this factor than blacks, whites, and the "other" racial category. These significant 
difterences by grade, by sex, and by race involved no significant interaction ef ects. 

In the analysis of students' scores on Factor 2, there were significant main 
effects for school, sex, and race, but not grade. Overall school differences in students' 
perceptions of the extent to which teachers promote competition and independent 
work among students were highly significant. Consistent with data from numerous 
other sources. School 2 is seen by its students as one in which teachers promote high 
levels of competition, significantly more so than students report for Schools 3 and 1; 
students in School 4 report lowest levels of all. Males perceived significantly more 
competition than females, a difference which is consistent with cultural ascribed 
values. Among racial/ethnic groups, whites reported that their teachers promoted 
competition and independent work to a lesser extent than "others," Asians, or 
Hispanics; and blacks scored significantly lower than Hispanics on this factor. 
However these overall differences need to be qualified as reported in Table 10.2, 
since interaction effects were significant as well. 
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TABLE 10.2 



SuTvnary of SignificarTt F Ratios from Four-Way Analyses of Variance of Student 
Factor Scores on Perceptions of How^ Their Teachers ?romote Learning, 
And Results of Duncan Tests of the Significance of Mean Differences 
On Significant Main Effects: School, Grade, Sex and Race 



Significant Effects df 



Duncan Tests of Mean Differences 



FACTOR 1 : Teachers Encourage Academic Achievement 



School 3 NS 

Grade 2 14.62"" 

Sex 1 11.96"" 

Race 4 5.09"" 
No interactions 



Grades < Grade 7 < Grade 6 

Males < Females 

Whites, Blacks < Hispanics < Asians 



FACTOR 2: Teachers Promote Conpetition, Independent Work 



School 
Grade 
Sex 
Race 



3 
2 
1 
4 



School X Grade 6 
School X Sex 3 

School X Race 12 



7.45"" 
NS 
20.91"" 
6.96"" 

2.70* 
5.41"* 

3.14**" 



School 4 < Schools 3, 1 < School 2 



Females < Males 

Whites < Others, Asians, Hispanics; 
Blacks < Hispaiiics 

VariatJie pattern only for School 3 

Males @ School 2 high; 
Females 9 School 4 low. 

Function of race; races not aqually 
distributed among schools 
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'p<.05 
**p < .01 
***p < .001 
•***p < .0001 
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Rewards and Punishments 

At the building and classroom levels, schools and teachers reinforced students' 
behavior publidy bv the rewards and punishments they issued. The expressed or 
perceived reasons for which the rewards and punishments were given tell students 
what they should and shouldn't do in school, what counts, y^at is valued. Items #25 
through 32 on the Student Questionnaire asked students to report on the nature and 
frequency of rewards and punishments in their schools. Their responses are 
summarized in Appendix B.4. Students reported receiving recognition from their 
schools for doing well at rates that are consistent across all four schools; 44% of the 
students said they were rewarded, and 52% said they were not. Asked what were they 
rewarded for, the students' answers did vary significantly by school. In Schools 1 and 
2, the most frequent reason was for academics; in School 3 it was art, and in School 4 
it was accomplishments with computers. Academic excellence was the principal 
reason overall, followed by 'other,' a category which students used to cite computer 
use and perfect attendance. Of the 44% of students who reported receiving one or 
more rewards, 38.2% said it was for academics 30.4% for 'other,' 20.3% for sports, 
13.7% for art. 8.9% for music, and 1 .9% for drama. 

Significantly more students reported being rewarded by their teachers (55%) for 
doing well than by the school (only 44%). Of the students whose teachers rewarded 
them for one or more reasons. 44.0% said it was for dasswork, 23.2% for homework, 
26.8% for tests. 34.6% for good conduct. 23.2% for helping out. and 4.9% for 
something else. Students at School 3. the smaller, predominantly black schoo.'. 
reported significantly higher rates of being rewarded by their teachers than students in 
the other three schools. The bases for the awards were also significantly different 
aaoss schools. In School 3. rewards were more likely to be given for dasswork and 
for good condud than in other schools. In School 4. the school with highest academic 
achievement overall, rewards were significantly less likely to be given for dasswork 
and good condud-they are taken for granted-but significantly more likely to be g.ven 
for good test performance and for helping others, as compared to the of^er three 
schools. 

A significant distinction between Schools 3 and 4 also appeared in the analysis 
of how teachers express these rewards to students. In School 3 students were far 
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more likely (40.7%) and students in School 4 far less likely (24.4%) to receive rewards 
in the form of 'small but fun prizes' than the total reported fur students over all tour 
schools (32.0%). The rates of tangible reinforcement corresponded closely but 
inversely with the rankings of the four schools on student achievement measures. 
Intangible or symbolic expressions of reinforcement, like teachers' writing nice 
comments on homework assignments or tests, and displaying students work were 
more likely to be reported in the higher achieving schools, especially School 4. 
Overall, students across all four schools reported receiving the following kinds of 
rewards from teachers: 32.0% received snail prizes; 55.?% had work displayed; 
18.9% said teachers sent nice letters home; 59.1% said teachers wrote nice 
comments on their test or homework papers; and 1 1 .6% reported some other reward. 

Knowingly or by instinct, teacher appeared to be practicing the research finding 
that positive reinforcement is more powerful than negative reinforcement. They 
rewarded students more frequently than they punished ihem. Almost half of the 
students (48.2%) reported that they have never been punished by their teachers; 
44.0% said 'sometimes;' 5.8% said 'a lot;' and 1.9% did not respond. Significant 
differences appeared in these responses by school. Students in School 1, the largest 
school with a substantial Hispanic enrollment, had 54% of their students reporting 
never having been punished by their teachers; ^f those who were, only half as many 
(3.9%) reported being punished a lot as compared with students in School 2 
(8.0%)and School 3 (8.3%). Students in School 2, whose achievement was 
consistently second to 'rhat of students in School 4, reported the highest rates of 
punishment by teachers, 51.1% reporting 'sometimes' and an additional 8.0% 
reporting 'a let.' Numerous observations combined with teacher interviews and 
conversations with the administrators confirm that School 2 emphasized law and 
order, and violations were dealt with promptly. 

Asked what one way most teachers in their schools punish students, the vast 
majority of students (77%) said 'by keeping students after school or after dass.' This 
rate was significantly higher than average for School 4 (83%), a finding which was 
confirmed by their vk:e-principal. Students at School 3 reported a significantly higher 
than average rate of teachers sending students to the prindpal's office as a means of 
punishment (10.6% versus 7.4% overall); that rate was significantly lower for students 
in School 4 (4. 1%) vA\ere reportedly teachers did not resort to this punishment very 
frequently. Olher forms of punishment were also used sparingly in all schools: 1.5% 
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of the students say teachers punish them k>y assigning extra wcrk; .9% by withholding 
gym or recess; 2,8% by talking to students privately; .9% by talking to students in front 
of everyone; and 3.5% by some other means. However, 4% to 5% of the teachers in 
all four schools reportedly resort to yelling at stur^^nts as a form of punishment. 

School level punishments ara reserved for more serious and/or sustained 
infractions, such as canrying a weapon, fighting, smoking, or substance abuse in 
school, and the punishment is more severe-suspension. Most of the students (85.5%) 
said they had not been suspended in the last year, but of those who said they had 
(1c 3%), significantly more than average came from School 3 (20.6%) and significantly 
fewer than average came from School 4 (8.2%). School 3 is a small, predominantly 
black, neighborhood school which had experienced more than its normal level of 
turmoil in the yea** student questionnaires were administered. School 4, which was 
more racially balarrced among minority groups, continued to enjoy its distinction for 
higher levels of student achievement. !t was also the only one of the four schools 
which enrolled more females than males; males were almost twice a:» likely as 
females to be suspended. 

Suspensions also con^elated significantly with grade and with race. Seventh 
and eighth graders were about twice as likely to be suspended (15.0% and 18.2% 
respectively) as sixth graders (8.2%). Blacks were suspended at a rate which was 
approximately four times that for Asians, three times that for whites, and twice that for 
Hispanics. The respective percentages were 20.9%(black), 4.0% (Asian), 7.8% 
(white), and 10.4% (Hispanic). It could not be detennined from the data whether 
students of certain racial/ethnic groups engaged more frequently in major 
transgressions, or whether schools discriminated against certain groups by applying 
the rules unevenly, or both. 



Respect and Affiliation Among Teachers 



Just as children learn ways of relating to people by watching their parents, 
students are influenced by and model the social interactions displayed by teachers 
and other adults in schools. Teachers who don't like each other and don't respect 
each other, and who act that way in front of students, communicate powerful negative 
messages to students about personal values and the value of schooling as an 
enterprise. However, among teachers who demonstrate high levels of collegiality, 



commitment to each other, to studetits, and to their work is strong (Firestone & 
Rosenblum, 1986). 

Teachers' Assessment of Collegiality by Questionnaire 

Collagiality among teachers was assessed by a set of items on the teacher 
questionnaire, in teacher inten/iews, by observation, and in selected items on the 
student questionnaire. Percentage distributions of fi equency of occurence for the 14 
items on collegia! behaviors reported by teachers in all four schools are shown in 
Table 10 3. Responses were keyed so that a one meant 'a lot" and a five meant 
'almost never." Factor analysis was used to identify a smaller number of underiying 
scales among these items. Results of this analysis are reported in Table 10.4, along 
with a summary of results from one-way analyses of variance by school on the 
teachers' factor scores for collegiality. Duncan tests of the significance of differences 
among means were used to determine which schools reflected more collegial 
behaviors. Although lower scores reflected more collegial behaviors, the ordering of 
schools by Duncan tests in Table 10.4 indicates which schools are more collegial. 

The first factor to emerge from factor analysis of the 14 items on collegial 
behavior on the teacher questionnaire was entitled "Interpersonal Behaviors." It had a 
very high eigenvalue of 5.46, accounted for 39% of the variance and pulled strongly 
worded, positive items like "engage, exchange, greet, share, step in for" referencing 
other teachers: all items had unusually high weights ranging from .71 to .86. Analysis 
of variance using scores on this factor as the dependent variable produced an F ratio 
significant at p < .03 which differentiated School 4 from School 3, the former assessed 
t}y its teachers as more collegial. 

Factor 2, accounting for 15.4% of the variance in the 14 items, designated task 
oriented behaviors-ones in which teachers wori< together to develop curricula, 
construct tests, or plan new programs, but not complain or joke about working 
conditions. It was a surprise to some reviewing this result to find that joking about 
difficult situations weighed negatively on this scale. It would seem that a sense of 
humor would be a tremendous asset in urban middle schools. However, if it is 
combined with sarcasm or lack of commitment, humor may demoralize or offend 
others. One teacher, obsen/ed by the project director at the completion of the 
administration of student questionnaires, handled a miscue on the changing of classes 

202 

ERIC ^ ^ 



TABLE 10.3 

Percantage Distribution of Teachers' Responses to Items on Coilegial Behaviors 



The Extent to Which Teachers: Percentage? 



ahiost 

alot somotimes nmw 



A. 


Engage in social convarsation 


32.6 


19.6 


39.1 


05.4 


03.3 


B. 


Exchange ideas about teaching 


18.5 


21.7 


38.0 


12.0 


09.8 


C. 


Discuss problenns about individual students 


40.2 


32.6 


20.- 


04.3 


02.2 


D. 


tMka negative remarks about other teachers 


19.5 


10.3 


34.5 


21.8 


13.8 


E. 


Great each other wannly 


25.6 


^3.9 


32.2 


08.9 


04.4 


F. 


Complain about working conditions 


34.8 


18.5 


29.3 


10.9 


06.5 


G. 


Joke about difficult situations 


25.3 


25.3 


38.5 


04.4 


06.6 


H. 


Discuss personal problems with each other 


05.7 


11.4 


45.5 


22.7 


14.8 


i. 


Share teaching materials 


13.3 


16.7 


46.7 


12.2 


11.1 


J. 


Discuss suggestions for new school programs 


12.0 


15.2 


33.7 


20.7 


18.5 


K. 


Insult other teachers directly 


04.3 


06.4 


25.5 


23.4 


40.4 


K. 


Devetop curriculum materials together 


02.2 


11.0 


36.3 


2C 3 


29.7 


L. 


Work on test construction together 


02.2 


04.4 


20.9 


16.5 


56.0 


M. 


Stop in for other teachers in emergencies 


29.3 


34.8 


20.7 


12.0 


03.3 
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TABLE 10.4 



Results of Factor Analysis of 14 items on Coilegial Behavior Reported by Teachers 
And Summary of One-Way ANOVA's and Duncan Tests by School 



racior Numoer & lyame 


eigen- 
value 


rCl Of 

Var 


v/Um 
Pet 




Korns on Uie raClUI 


Woinhf 
weiym 


1: Interpersonal Behaviors 


5.46 


39.0 


39.0 


A. 


Engagt In social conversation 


.77 








B. 


Exchange Ideas about teacNng 


.75 


F-3.08:p<.03: 








c. 


Discuss nroUems about Individual students 


.83 








E. 


Greet each other warmly 


.86 


(Sch 4 < Sch 3)' 








L 


Share teaching materlab 


.80 








N. 


Step In for other teachers In emergencies 


.71 


2: Task Oriented Behaviors 


2.16 


15.4 


54.4 


F 


Complain about working conditions 


-.72 










G. 


Joke about difficult situations 


-.63 


F = 2.47:p<.06: 








J. 


Discuss suggestions fbr new school programs 


.57 








L. 


Devek>p currk:ulum materials together 


.84 


(Sch 4. 1< Sch 2)' 








M. 


Work on test construction together 


.84 


3: Unprofessional Behaviors 


1.61 


11.5 


65.9 


D. 


Make negative remarks about other teachers 


.62 








H. 


Discuss personal problems with each other 


.73 










K. 


InauK other teachers directly 


.64 



Tor Factors 1 and 2. lov^er means indicate more colldgial behaviors. 
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with apparent deftness and humor. Asked about his role in the school, other 
ot)sen/ers noted he was not on the prindpal's leadership tearrt, nor was he involved in 
any of the school's numerous, externally funded, special projects. Several months 
later, an interview transcript explained v^hy. He expressed no commitment to the 
school or its mission. His teaching job was a way to bide time jring the school year 
until he could make 'important money' on his 'real' job during the summer. 

The F ratio from one-way analysis of variance of scores on Factor 2 among 
schools was significant at p < .08. (Liberty has been taken in relaxing the conventional 
.05 level for reporting of significant results; because the n's for teachers are small, the 
and the degrees of freedom therefore limited, a fairly large difference is required for 
statistical significance.) Teachers in Schools 4 and 1 reported significantly higher 
rates of task oriented coiiegial behaviors than teachers in School 2. This was 
corroborated in inten/iev^ with teachers and principals. Teachers in School 2 had no 
common planning time; students were assigned to classes exclusively on the basis of 
MAT-Reading scores, and test performance was of overriding importance in the 
School. It was not a coiiegial environment. In contract, teachers in the higher 
achieving School 4 had been organized in clusters for several years; the principal 
made sure that each cluster had its own convenient teachers' room for scheduled 
meetings and informal planning. The principal in School 1 , one of the lower achieving 
schools and by far the largest, recognized the need for her teachers to engage in 
collaborative planning and development; she had instituted several programs which 
were still in their initial phases at the time of Ocia collection. 

The third factor extracted from factor analysis of the items on coiiegial behavior 
was entitled 'Unprofessional Behaviors.' It included making negative remarks about 
other teachers, insulting them directly, and discussing personal problems. While the 
factor may be meaningful, the factor scores are suspect for their reliability and validity. 
The ijow of response options was inadvertentiy omitted for item K, and half of the 
respondents left the item blank, while the other half wrote in the number and circled it. 
Factqr scores for those omitting the item would appear to be far more negative, since 
low tvifrbfif^ responses indic^^ted greater frequency of the behavior. Instead. 
ANOVA's were computed separately for the two other items which appeared on the 
factor, making negative remarks, and discussing pei^onal problems. Neither F ratio 
was significant. 
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The one teacher to one dassroom model of organization of schools separates 
teachers from their colleagues and promotes isolation. But like most other workers, 
teachers are more committed to their work when norms and working conditions 
promote interpersonal attachments (Buchanan, 1974); isolation from other teachers 
and administrators reduces commitment (Zielinski & Hoy, 1983). Teachers prize the 
respect of their colleagues and value opporturvties to interact with them (Firestone & 
Rosenblum, 1988). Not only do these opportunities promote commitment, they can bB 
instrumeiTtal in improving teaching; teachers learn trom each other, and their teaching 
skills are improved when they have frequent professional interaction with each other 
(Rosenholtz, 1985). 

Commitment and Affiliation as Reflected in Teacher Interviews 

Asked what they liked most at)out teaching in their schools, teachers spoke first 
id foremost at)out their students. However, once they had addressed that subject, 
die teachers spoke at)out professionalism, in positive terms if their needs were being 
met, or in temis of the changes they would like to see take place in their schools if they 
were unhappy with their situations. Teachers want to be treated like professionals; 
they want participation in decision making on important issues. They value collegiality 
fostered through cluster programs or other arrangements that give them time to 
collaborate on curricular decisions, and to share information about individual students. 
Teachers who had these opportunities credited them as major sources of job 
satisfaction; those who were unhappy with their situations named isolation and the 
lack of opportunities to work with othei teachers as things they sorely needed. These 
assessments are reflected in the following miscellaneous quotes: 

The duster system meets weekly with administrators but is teacher led. 

Teacher relationships are very good.' 

'Even as a first year teacher in the building, you have a voice.' 

'We have frequent discussions of students; they don't get lost.' 

'It's not unusual for teachers from this school to give up time on their weekends 
to help students, or to work on a spedal project.' 

'All the teachers here are expected to be good teachers.' 

'Not everyone gets along well, but all in all, the teachers here treat each other 
with respect.' 

'We all work toward the same goal-teaching students the best we can.' 
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How Students View Teacher Affiliation 

Coliegial behaviors among teachers are noted by students. The models of 
behavior provided by the teachers' own conduct in school are some of the most 
important ways in which norms for behavior are communicated to students in the 
schools. Students look to teachers to see if they are treating others with kindness and 
respect. Students also want respect for themselves-the knowledge that they are 
being treated with fairness and decency by adults in school, most notably the teachers, 
with yMhom their interaction is most frequent and most direct. Wehlage and Rutter 
(1986) reported that a substantial group of students in urban high schools believe that 
they are routinely treated unfairly by teachers. Natriello (1G32) ODserved that where 
students experience unfair treatment, their commitment wanes. 

The students' view of their teachers' affiliation with each other, with the 
prindpal, and parb'culariy their care and concern for students were addressed in items 
from Section 16 of the Student Questionnaire. Students behaviors toward each other 
were also queried. In these items students were asked to make assessments from a 
school-wide perspective. Factor analysis of these eleven items yielded three factors 
whose eigenvalues, percent of variance and item weights are shown in Table 10.5. 
Entitled 'Our School is Better,' Factor 1 included items stating that teachers in their 
school care more and students learn more than those in other schools. Factors 2 and 3 
contained three items each on teacher affiliation and student cooperation respectively. 
Factor scores were created by adding raw scores for the items assigned to each factor. 

Four-way analyses of variance were conducted on the factor scores to 
determine differinces among students by school, grade, sex, and race. Results are 
reported in Table 10.6. The ANOVA using scores on Factor 1 for the dependent 
variable produced significant differences by school, grade, and race. Students in 
School 3 were significantly lower in their belief that the education they were getting In 
their school was better; seventh and eighth graders were significantly more negative in 
this regard than sixth graders. Black, whites, and 'others,' held lower esteem for their 
school than Hispanic, and in turn Asians. However, these findings needed some 
modification, since two interaction effects were significant. Students in particular 
radal/ethnic groups were more positive atx}ut their evaluation of some schools than 
others: Asians at School 2, whites at School 4, and Hispanics at Schools 1 and 4 
were even more positive about their schools tiian their same race counterparts at other 
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TABLE 10.5 

Results of Factor Analysis of Student Perceptions of School-Wide lnfluer)ces on Their School's Climate 



Factor Numt>er & Name Eigen- Pet of Cum Items on the Factor Weight 

value Var Pet 



1: Our School Is Better 3.35 30.4 30.4 C. Teachers give students extra help with their work .43 

H. S^ider1ts here learn a lot more than students from .64 
other schools 

I. Students here are expected to do homework 4-5 .69 
tbnesaweek 

J. Teachers are a tot wotb about their students than .66 

teachers from other schools 
K. Most students feel very ck)se to their teachers .47 



2: Teachers Like Others 1.14 10.4 40.8 E. Teachers seem to Hke the principal .82 

F. Teachers seem to like each other .77 

G. Teachers seem to like the students .47 



3: Students Cooperate 1.07 9.8 50.6 A. There are unfriendly cliques (groups) - 65 

B. Students help each other .63 
D. Students try to help each other with school work .65 
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TABLE 10.6 



Summary of SignificarTt F Ratios from Four-Way Analyses of Variance of Student 
Factor Scores on Perceptions of School-Wide Influences on School Climate, 
And Results of Duncan Tests of the Significance of Mean Differences 
On Significant Main Effects: School. Grade, Sex and Race 



Significant Effects 


df 


F Duncan Tests of Mean Differences 


FACTOR 1 : Belief That Their School Is Better 


School 


3 


4.46" School 3 < Schools 1 , 2, 4 


Grade 


2 


1 3.01 Grades 7, 8 < Grade 6 


Sex 


1 


NS 


Race 


4 


12.27*"* Blacks, Whites < Hispanics < Asians 


School X Race 


6 


1.91* 


Sex X Grade 


2 


3.81* 


FACTOR 2: Teachers Like Each Other, the Principal, and Students 


School 


3 


5.90*" School 3 < Schools 2, 1, 4 


Grade 


3 


9.20**** Grades 7, 8 < Grade 6 


Sex 


1 


8.10** Males < Females 


Race 


4 


7.02*"* Stacks, Asians < Hispanics 


No Interactions 







FACTOR 3: Students Are Cooperative, Friendly Toward Each Other 



School 


3 


3.29* 


School 3 < Schools 1, 4 


Grade 


2 


12.86**" 


Grades 7, 8 < Grade 6 


Sex 


1 


17.53**" 


Males < Females 


Race 


4 


6.81**" 


Whites, Blacks < Hispanics, Asians 


No Interactions 









*p<.05 
**p < .01 
***p < .001 
****p < .0001 
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schools. Males' assessment of the quality of education and care provided by 
teachers at their schools continued to decline over grade levels, whereas the 
assessment t}y females declined in seventh grade and improved in eighth grade. 

Scores on Factor 2 were a composite of the students' perception that their 
teachers seem to like each other, tfie principal, and the students. Four-way analysis of 
variance of these scores produced significant results for all main effects but no 
significant interaction effects. Again students in School 3 had significantly more 
negative perceptions about their teachers' regard for others th&n students in the other 
schools. Students in grade six held significantly more positive views about their 
teachers' liking others than did students in grades seven and eight. Females were 
more positive than males, and Hispanics were more positive in their assessment thar 
blacks, 'others," and Asians. Interestingly, this was the only occasion in the study 
wnen Asians fol! on the negative side of a significant finding regarding affective 
behavior. 

Analysis of Factor 3 scores on student cooperation once again differentiated 
students in School 3 from students in Schools 1 and 4. (The mean for students in 
School 2 fell in between those tor Schools 3 and 1.) As for Factors 1 and 2, students 
in grade six were more positive in their assessments of students' cooperative, friendly 
behaviors than students in grades 7 and 8, and again the females were significantly 
more positive than the males. Also consistent with most other findings from the study, 
wolte and black students perceived significantly lower levels of student cooperation in 
their schools than Hispanic and Asian students. 

Administrative Support for Teachers 

There are a number of ways in which principals can support teachers and 
thereby contribute to their perfomiance in the classroom. One of the most important 
among these to teachers is the principal's exercise of control over the school's public 
places and consistent enforcement of discipline. Teachers expect principals to 
provide a sympathetic court of appeals when they have problems controlling students 
and when they have disputes with parents. Teachers also expect principals to 
minimize disruptions to their classroom routine (Rosenholtz, 1985). In addition to the 
principal's fair and consistent use of authority and control, teachers also benefit from 
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mor« proacth/e, enabling strategies and from instructional leadership. The former 
Includes the assignment of pleasant workspaces, arrangement of teaching times and 
dass schedules so that teachers can meet with colleagues and so that responsibilities 
are assigned equitably. Teachers also look to the principal for the provision of 
necessary materials. 

Evidence from Teacher Intervievt/s 

Even though questions about principals were not posod directly, the interviews 
with teachers revealed a great deal about how they related to their principals and how 
supportive he or she was to their teaching efforts. Teachers like principals who hold 
dear, high expectations; who practice strict, and consistent enforcement of disdpline; 
who enforce the schedule to promote attention to academics, and limited interruptions 
to dasses The teachers wanted their prindpals to provide adequate resources and to 
give them some say in dedsion making. Prindpals who drew the highest praise from 
their teachers appeared to exercise a delicate balance between strong leadership and 
sharing of power with their teachers, as reflected in the following comments: 

"We get a lot of support. He's always willing to listen to you. If your idea is 
better, he'll change. 

'The school is well run. You may not like all of his dedsions, but he is a creative 
genius, fosters productivity in everyone. 

One teacher sought a well disdplined school with fimner control, security, and 
safety than the one he had just left so that he would have more opportunity to deal with 
curriculum issues; he liked the style of his new principal very much: 'Mr. X is 
everywhere! There's very little that gets by that man! ' Another teacher echoed that 
praise: 'Mr. X has a lot to do with the atmosphere. There's freedom, trust, and 
respect for the people who wori< in the building. I don't know how he does it. There's 
method to his madness.. ..As a spedalist, I've wori^ed in several buildings in the 
systems, so I've seen a few principals and how building are run. Here It's like I died 
and went to heaven.' Another expressed appreciation for competent management this 
way: 'I was at a school where tine kids had better home I'ves but the school was so 
por-'y run, tiie staff was totally demoralized, I had to get out. It's much better here.' 

Teachers also said they valixd supervision if it was done constructively: 
'There's real supervision in tills school; tiie first week he was in my dass eight times; 
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he never interrupts, and notices everything, even how you taik to kids in the hall.' But 
despite the careful ot)servation, teachers and other professionals with effective 
principals felt they had the latitude to try new ideas and to risk making mistakes. One 
Interviewee was a librarian who explained that she had been given complete latitude 
in scheduling the use of the library; when she asked her principal what to do about 
something, the reply was 'I hired you as a librarian, now be a librarian.' 

Evidence from Questionnaires 

The principal and other administrators are a crucial source of respect for 
teachers. The support principals provide is critical to teachers' classroom performance 
and to their retention in the field (Dworkin, 1987). Teachers in the present study 
echoed that sentiment. Asked to rate 1 4 aspects of their job v»rith respect to importance 
(See Appendix A, Section 17), teachers placed administrative support in improving 
student achievement in third place, after teacher/^upil relationships and job security. 
Fourth ranked in order of importance was teacher authority over students, an issue on 
whicn teachers also expec^t support from principals. Teacher/administrator 
relationships v./as ranked sixth in order of importance, ahead of teacher/teacher 
relationships wnich was ranked ninth. 

In t^e teachers' view, the principal's responsibilities should t>e primarily 'to 
oversee school operations and scheduling,' and secondarily, 'to lead curriculum and 
program planning.* Providing resources to teachers was ranked a distant third, 
followed by disciplining students and supen/ising teachers. Cleariy most of the 
teachers prefer to see the principal act in an enabling, facilitating role, rather than in a 
supervisory role. Ar^d while the provision of resources and student discipline are 
downplayed, it was apparent from teacher inten/iews that when teachers cannot meet 
these '.eeds on their own, they place great emphasis on the prindpal's response to 
these needs. 

Loyalty to One's School 

Teachers who derive satisfaction from helping students learn, and who like and 
respect their colleagues, are likely to deveiop commitment to that particular school. 
One of *^e most telling statistics ir. this regard was the percentage of teachers who had 
been teaching at their school five years or less, when more than 65% of the sample 
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had been teaching 10 years or more. Fully 91% of the teachers at School 3 had been 
teaching there 5 years or less; 33% of the teachers there were first year teachers. The 
school had a reputation as a troubled place; in a school consolidation plan enacted 
just prior to the beginning of the study, it received a number of students from another 
school said to be the 'dumping ground for behavioral problems' before it was dosed. 
At the time of data collection for student and teacher questionnaires, School 3 had its 
third principal in less than a year. Teachers in junior positions reportedly entered the 
system in School 3 and then requested reassignniant to other schools as they gained 
in seniority. In contrast, only 31% of the teachers st School 4 had been teaching there 
five years or less. It was a place which celebrated student achievement and embodied 
art ethic of caring; it was a place where teachers wanted to stay. Schools 1 and 2 fell 
between these two extremes; 58% and 64% of their teachers respectively had taught 
at these schools five years or less. 

Conceivably a school's physical environment might have an influence on 
whether As users look fo'ward to being there. None of the four schools in the sample 
had an attractive physical facility. Both School 3 and School 4, the most troubled 
school together with the highest achieving school, were located in decrepit buildings, 
parts of which were more than 100 years old, and most of which were pooriy 
maintained and in great disrepair. School 1, lowest in academic achievement, with its 
large student body and strong Hispanic influence, was located in a building whose 
condition was slightly better. School 2 had the best physical facility of the four, but it 
too needed maintenance and repairs. What was striking atx}ut School 2 in contrast to 
the other three schools was the sterile quality of its common places; there were no 
posters, murals, paintings or student's papers announcing who was there, only quiet, 
dart< comdors lined with brown tiles. In conti-ast, the other three schools, especially 
School 4, looked alive with brightiy colored murals, paintings, maps, flags, and 
displays created by the students. 

As reported on items 26 and 27 of the teacher questionnaire, the school's 
physical environment was tiie tiling teachers liked least about teaching in tiieir school, 
and the tiling tiiey would most like to change. Numerous comments from tiie teacher 
questionnaire and frequent observations con-oborate tiiese reports. These schools 
are in great disrepair, and they should be refurbished or replaced. However, the 
overwhelming evidence points to teachers arxj principals arxj what tiiey do to engage 
students in learning as tiie most important factors in tiie success of schools. 
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Summary and Discussion 



Teachers exert pervasive influence on students' behavior. Their realm of 
influence includes not only academic achievement, but also social norms and values. 
The mechanisms by which they do this include setting expectations, providing models 
of behavior, and giving students feedback on what they do. The central task for 
schools and for students in particular is to engage students, so that tney put forth 
serious effort and develop a commitment to mastering schoolwork. Social 
psychological dimensior^ of this task are not only instrumental to student learning but 
also important ends in their own right, such as showing respect for others, affiliating 
with others and sharing commitments. 

The social psychological dimension of schools appears to be particulariy 
important for students at risk for school failure dr dropout. Rather than viewing these 
students as ones with a disadvantage or deficit, it may be more constructive to note 
their higher sensitivity to positive school environments. Students at risk of school 
failure may be the very ones who stand to gain the most from the social capital which 
the schools need to provide, since families are no longer well equipped to do so. 
Such vulnerable students may be even more responsive to positive social and 
educational environments than students whose homes extend the achievement and 
value orientation of their schools. 

The importance of a safe, orderiy environment to a positive school dimate has 
been recognized for some time; the influence of high expectations on student 
achievement has t>een known even longer. What is more recent, but perhaps just as 
important for students at risk, is careful documentation of the importance of a caring 
environment. An ethic of caring promotes respect, affiliation and commitment among 
the adults and students in the school. These effects are mutually reinforcing for 
students and teachers: but if one side is low, it will depress the other. Factors 
contributing to this cycle of commitment include not only respect and diriliation, but 
a'so relevance, administrative support for teachers, fair and consistent treatment of 
students according to clear rules, and having a sense of control over one's work. 
Several of these factors need to be orchestrated on a school-wide level by the 
principal. 
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Indicators of teacher behaviors as well as the influence of teachers and 
principals on teachers and students were developed as part of the present study. 
Results of these measure.- were corroborated by interview and observation and shown 
to be related to the academic achievement rankings and prosodal behaviors in the 
schools. Teachers' confimitment to students was attested in teachers' assignment of «1 
ranking to the importance of teacher/student relationships to job satisfaction, a finding 
which was overv^elming endorsed in interviews. Teachers in all four of the sample 
schools serving predominantly minority youth expressed shared responsibility for 
student achievement. The primacy of the academic mission of the school was 
recognized by students in both higher and lower achieving schools. 

What differentiated higher and lower achieving schools was an ethic of caring, a 
sense of cooperation among students, collegiality among teachers, and a mutual 
commitment between students and teachers. Principals were instrumental in making 
this possible, by exhibiting a strong sense of leadership in delicate balance with the 
sharing of power. Teachers felt support from each other and from principals; they had 
common planning time and a place for meetings. Students in schools whose teachers 
exhibited collegial behavior and affiliation toward others in the building were more 
likely to cooperate with each other. In turn, more cooperative rather than competitive 
teaching patterns, were associated with higher levels of student achievement. 

Competition to do better than other students on tests and grades was negatively 
associated with achievement measures. Of particular note, this factor provided a dear 
separation between the two higher achieving schools. The school whose achievement 
was highest overall, and highest in comparisons within regular and special education 
programs-on every measure of achievement-had no advanced wori< classes, nor did 
it have the Asian bilingual program, both of which favored the second school. 
Moreover, the highest achieving school had a physical facility which was not neariy as 
pleasant and accommodating as the second-ranked school. Both drew virtually the 
same size enrollments from very similar, adjacent communities. If anything, the 
second school could be said to be more advantaged, yet it was significantly 
outperformed by the first. 

An ethic of caring made the difference. It permeated all of the data we 
collected-from students, teachers, and principals. The difference was not at all 
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obvious at first; the schools felt different; the social interactions were different, but it 
was not until months after the study was engaged that a dearer picture emerged. 
When this qualitative picture was corroborated among several members of the 
research team who had visited the schools several times, the quantitative results of 
both student and teacher questionnaires only confirmed the results. The findings are 
significant not only for what they say about factors affecting student achievement, but 
especially because they are alterable variables amenable to change by helping 
principals to exercise effective leadership with the sharing of power, and by helping 
teachers to employ effective teaching practices with an ethic of caring. 
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CHAPTER 11 

WHAT IS IMPORTANT AND SATISFYING TO TEACHERS 



The Unltecl States is experiencing one of the longest periods in its history cf 
sustained attention to the problem of improving the quality and productivity of public 
schools. Now in Its eighth year of highly visit>ie efforts, the movement has heard calls 
for reform from presidents, governors, legislators, foundation chiefs, prominent 
corporate officials, chief state school officers, union leaders, and academics among 
others. Many solutions have been proposed which outstrip knowledge of their effects. 
One such example is minimum competency testing for teachers as a means of raising 
standards for entry and certification in the teaching profession. 

In fact, the United States has the best educated teaching force it is likely to have 
for years to come. The reason is quite simple, as Wise (1990) points out: a lot of 
teachers had no real options when they made their career decisions, and schools 
benefited from their limited opportunities. Now. equality of access to occupations 
means that society can no longer trap smart young black people and smart young 
women in teaching. According to Feistritzer (1986), the teaching force is now 
composed mainly of people in middle to late career; their average age is approaching 
50, and 75% have been teaching at least 10 years, 50% for 15 years or more. The 
thousand plus pieces of legislation enacted across the nation, in virtually every state to 
reform teacher education focus particularly on teacher licensure, for those entering the 
profession, and some on the supen/ision of beginning teachers (Dariing-Hammond 
and Berry. 1988). 

These efforts will be insufficient for at least two reasons. One is that more 
senior members of the teaching force will not be affected by changes in licensure and 
they are still many years from retirement. A second is that valid assessment of teacher 
competence is a challenge which outstrips presently available tasting and 
assessment procedures. It is argued here that staff development is crucial to 
promoting and sustaining teadier competence for both new and veteran teachers, and 
that knowledge of subject matter and pedagogy are not all tlrat we should be 
concerned about in the selection and supervision of beginning teachers. 
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Who Is Attracted to Teaching? 



Some b\ame the decline in school perfoimance on the declining quality of 
teachers (Weaver, 198S). The solution, as the argument goes, is to attract txight 
people to the teaching profession. The prot)iem with this ""^s is that many bright 
people are already there, and more bright young people f .tailing to enter teacher 
preparation programs, as salaries become more attract! 'e 4 > alternative professional 
pursuits appear less attractive than first envisioned. Others are retumina to teaching. 

The teachers from the four urban middle schools which constitute the sample for 
the present study mirror the national pattern of a highly educated, experienced teacher 
force. As reported on their questic.inaires and confirmed by school records, the 
teachers are highly educated. Their answers to the questicn: 'What is the highest 
degree you hold?' can be summarized as follows: 

1. Less than a Bachelor's degree (0.0 % ) 

2. Bachelor's degree ( 1 1 .2 % ) 

3. Some graduate work but less than a Master's degree (27.0 % ) 

4. Master's degree (19.1% ) 

5. Mnre itian a Master's degree but no'; a Dociorate (42.7 % ) 

Similariy, the teachers in the sample were highly experienced. In response to 
the question: 'How many year3 of experience as a teacher have you had? Irdude 
this year as one year of experience,' they reported: 

(a) 1 -Syears: 15.4% 

(b) 6 -10 years: 19.8% 

(c) 11 -15 years: 15.4% 

(d) 16-20 years: 27.5% 

(e) 21 - 25 years: 11.0% 

(f ) more than 25 years: 1 1 .0% 



Let's Not Repeat Medicine's Mistake 

If academic excellence becomes the over-riding concern in teacher education 
programs and teacher selection and licensure, education may stand to repeat the 
mistake of medicine in its single-minded pursuit of highly qualified applicants and its 

218 



rewards for high grades above all else. Derek Bok, President of Harvard University, 
captured the essence of the problem when he said that schools of medicine were 
training the compassion right out of their medical students, undoing the very prized 
quality we want to see in doctors who treat us and our families. Since then Harvard 
and several other prestigious institutions have revamped their medical programs and 
have provkled variable routes to entry in an effort to maintain quality while minimizing 
tne negative effects of severe competition. 

Even with irx:reases in salary scales, bright young people v«nl! itot be attracted to 
teaching only for the money; there are too many other opportunities for higher paying 
work. Individual's value for the other satisfactions which can oe derived from teaching 
need to be considered. The paradigms for research on teacher effectiveness 
(Medley, 1983) and school effectiveness (Newmann, 1987) which have changed our 
thinking about how to study teaching and schooling call attention to what actions 
teachers and others take to promote achievement, rather than what passive 
characteristics or credentials they possess. But rather than being 'passive' traits, the 
value systems of teachers may be necessary but not sufficient conditions for engaging 
students arxi promoting optimal achievement. 

This research has already demonstrated that the highest achieving school 
combined emphasis on academic achievement with an ethic of caring, whereas the 
school which appeared to be outwardly more advantaged sitressed test performance 
without commensurate levels of cooperation and caring. What may make teachers 
excel at their craft are not just mastery of subject matter and expertise in curriculum, 
cognition and pedagogy, but also commitment, caring, and dedication to students. 
Teachers need to hold important values; schools need to be structured and managed 
so that positive values are promoted arxi reflected in what administrators, teachers, 
and students do in schools. 

The former principal of the highest achieving school in the study seemed to 
have mastered a formula for the right combination of important ingredients in 
successful teachers and how to keep them productive. He had just left the school to 
assume a position in the central administration after serving as principal of School 4 
for 1 1 years. The teacher force he left behind included a large percentage who had 
been recruited by him to their school. In separate interviews, we heard the story of 
their acceptance interview with that principal like a popular refrain: 'You have to love 
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the kids; you have to be a master of your subject matter; arxj you have to start teaching 
five minutes before the bell rings.' 

What Is Important to the Teachers 

Teacher interviews began with the question: 'What do you like most atx}ut 
teaching in this school?' Almost all respondents, regardless of the school or the 
Interviewer, said 'the students,' and proceeded to expound on how important and 
satisfying were their relationships with students, 'my kids.' That sentiment was 
corroborated by results from section 17 of the teacher questionnaire. Presented in 
pairs, fourteen items inquired how important were various issues to job satisfaction, 
and how satisfied teachers were with that aspect of their jobs. The percentage 
distributions of results for teac*iers in all four schools are given in Tat>le 11.1. The 
importance of teacher/pupil relationships received the highest percentage of teacher 
responses in the top category (91.2%) and, as shown in Table 1 1.2, the highest rank 
overall. Satisfaction reported from teacher/pupil relationships averaged one and a 
half score points lower on the scale, but still received the highest rank for sources of 
satisfaction overall. 

Job security received the second highest rating in terms of importance to 
teachers, but it was an issue about which teachers were among the least satisfied. As 
a result, it ranked high in terms of the discrepancy between importance and 
satisfaction, as shown in Table 1 1 .2. The timing of data collection may have been 
partially responsible for the low level of satisfaction reported by teachers. Many of 
them had just received 'pink slips' informing them that their contracts would not be 
renewed. It was a rite of spring which these teachers dreaded year in and year out. 
whose negative demoralizing effects were diminished only partially when many of the 
recipients were rehired the week before school opened, after a summer of uncertainty. 
Teachers reported resentment over the criteria which were used in deciding 
termination. By all accounts, it was not merit, or competence, or seniority, but other 
factors; black, bilingual, and special education teachers were far more likely to be 
retained. Unfortunately, the issue of job security took on racial and ethnic overtones. 

The annual rite of spring for teachers continued. Front page news in The 
Boston Globe announced: 



220 



7790 Boston School CommiHoo tonight Is sxpsotsd to set on s rocommsndstion by 
Suporintsndent Josoph MeDonough thst about 370 tonund tMchsrs bo Imid off to keop the 
system wHNn its budgst. 

If such kyoffSMf9Mpprov9d,wiiming not/CBS wU go out to M total of 6X 
in Boston, because selection of the 370 to be laid off will be determined by whether US 
Judge W. Arthur Garrity ends court supervision of school desegregation ti^is month, as he has 
said he plans to da 

ITtey are covering all the bases. If Judge Garrity decides to stay on tiw case they will 
have to use racial percentages to govern layoffs. If he ¥¥lOidraw% then seniority will detennine 
who gets laid off, ' said Edward Doherty, president of the Boston Teachers Union. 

Layoff notices have already been sent to 400 provisior^al, or nontenured teachers.(The 
Boston Globe, May 8, 1990, p. 1). 

Parent/teacher relationships were deemed by teachers to be very important, on 
a par with administrative support for teachers, teacher authority over students, level of 
student achievement, teacher/administrator relationships, the curricula in the school, 
and even slightly more important than teachers' relationships with their colleagues. 
However, teacher satisfaction with parent^eacher relationships ranked dead last 
among the 14 items, making it the issue over which there was greatest discrepancy 
between importance and satisfaction. Many of the teachers who were interviewed, 
especially those in the lower achieving schools, said that they wished they had more 
opportunities to involve parents in their children's education, so that teachers and 
parents coukJ reinforce each others' efforts. Some of the teachers wondered whetiier 
their students had any regular supervision at home. A few teachers who lived in the 
same neighborhoods as their students told us of the times they called the parents and 
went to their hom^^ when their children were in trouble. It seemed that most teachers 
were unwilling or unable to do this. They felt the connections should be made through 
the schools. 

One of the four schools. School 1, had the lowest level of academic 
achievement overall, but a more positive position on iieveral of the social and 
behavioral indices. School 1 was by far the largest of the four schools and enrolled a 
significaf!t number of Hispanic bilingual students. Despite these challenges. School 1 
was far more successful than the ottier schools in getting parents to come to the 
school Its black female prindpai insisted ti^iat parents come to the school to receive 
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TABLE 11.1 



PorcanUgo Distribution of TMchars' Ruporms to Items Regarding ths Impoftancs 
And Satisfaction They Assign to Various Aspaets of Thair Jobs 



A. Salary: 


Very important 
Very satisfied 


47.8 
17.4 


29.3 
21.7 


19.6 
33.7 


02.2 
18.5 


01.1 
08.7 


Very L/ziimportant 
Vtry umatisfiad 


P. JOd securny 


very imporcani 
Very satisfied 


oc.c 
1 6.9 


in n 
11.2 


u#,o 
21.3 


03 3 

M.i 


38.2 


Varv L/flimDOrtant 

Very umatisfled 


C. Level of student 
achievement 


Very important 
very sausiieo 


80.2 


12.1 


05.5 


00.0 
27 2 


02.2 
IBS 


very (important 
varv lifBatlsfied 


D. ParentAeacher 

relationsliips 


Very Important 
very sansneo 


79.1 
mo 


13.2 
uo. r 


03.3 


01.1 

93 Q 


03.3 
33 7 


Very (/nimportarl 
Varv li/satlsfiad 


E. Teacher/teacher 

relationships 


Very Important 
very satisned 


58.2 

08,7 


33.0 

Z0.7 


04.4 

40.0 


02.2 
19 n 


02.2 

1*; 9 


Very (/nimportant 
\/mr\i linsatisfiad 


F. Teacher/pupil 
reiaiionsnips 


Very Important 
very sausneo 


91.2 


06.8 


00.0 

9ft 7 


00.0 

Oft 7 


00.0 
10 9 


Very (/nimportant 
Verv unsatisfied 


G. Teacher/administra- 
tor reiauonsmps 


Very Important 
very sausneo 


75.6 

1 f .0 


ia9 


03.3 

9i( 


00.0 
1^ 


02.2 
19 8 


Very (/nimportant 
Varv iinaatlsfiad 


H. The curricula in 
scnowi 


Very Important 

\JmrM mm^lmfimA 


71.7 

us. 9 


22.8 

22 0 


04.3 

38 S 


01.1 
16.5 


00.0 
13.2 


Very (//limportant 
Very unsatisfied 


i. Teacher 
auxonoftiy 


Very important 
very saiisiieo 


53.9 


34.8 

9R 1 


09.0 


02.2 
12 S 


00.0 
14 8 


Very (/nimportant 
Verv unsatisfied 


J. Teaclw authority 
over students 


Very important 
vary saxisnea 


73.6 

OA 0 
U0.9 


24.2 

9** 


02.2 

O 1 . 1 


00.0 
16 7 


00.0 
20 0 


Very (/nimportant 
Varv unsatisfied 


K. Teacher evaluation 
procedures 


Very Important 
Very satisfied 


37.8 
11.1 


26.7 
11.1 


25.6 
41.1 


04.4 
14.4 


05.6 
22.2 


Very (/nimportant 
Very unsatisfied 


L Recognition for 
teacher achievement 


Very Important 
Very satisfied 


56.0 
06.7 


28.6 
18.0 


12.1 
25.8 


01.1 
25.8 


02.2 
23.6 


Very (/nimportartt 
Very unsatisfied 


M. Pariicipationin 
malting decisions 


Very important 
Very satisfied 


51.6 
04.4 


39.6 
07.8 


07.7 
41.1 


01.1 
25.6 


00.0 
21.1 


Very L/nimportant 
Very unsatisfied 


N. Admlnistrativt support 
1,1 Improving student 
achievement 


Very Important 
Very satisfied 


74.4 
12.4 


23.3 
22.5 


02.2 
33.7 


00.0 
15.7 


00.0 
15.7 


Very (/nimportant 
Very unsatisfied 
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ERIC 



Tabia 11.2 



3ank Crdar. Maara and Standard D«/lationB of Ratings GIvan by Taachars on the 
Importanca of. and Satisfaction with. Various AapM:ts of Their Jobs 
And the Discrepancy Between Importance and Satisfaction 



Aspects of Teacher'sJob Importance (I) Satisfaction (S) Discrepancy (I - S) 
Rated High (1) to Low (5) 





Rank 


X 


s 


RanK 


X 


s 


RanK 


X 


s 


A. Salary 


» 13 


1.79 


.91 


t 2 


2.79 


1.19 


»14 


-1.00 


1.50 


B. Job Sacuriiy 


t 2 


1.27 


.72 


t12 


3.44 


1.51 


» 2 


-2.16 


1.70 


C. Lovel of student 
achiovomont 


t 5 


1.30 


.78 


tlO 


3.40 


1.10 


t 3 


-2.10* 


.47 


D. Parant^taachar 
ralationshipa 


t 8 


1.35 


.88 


t14 


3.61 


1.33 


t 1 


-2.26 


1.54 


E. TaacharAaachar 

relationships 


a 9 


1.55 


.87 


t 7 


3.04* 


1.14 


»11 


-1.49" 


1.36 


F. Teacher/pupil 
relationships 


a 1 


1.08 


.31 


t 1 


2.58 


1.22 


tio 


-1.50 


1.22 


G. Teacher/administrator 
relationships 


a 6 


1.33 


.76 


t 4 


2.96 


1.37 


» 9 


-1.63 


1.39 


H. The curricula in school 


a 7 


1.35 


.62 


» 6 


3.01*' 


•1.15 


» 8 


-1.70" 


1.24 


1. leacner auionomy 


1 1 
» 1 1 


1.60 


.75 


* O 








-1.36 


1.44 


J. Teacher authority over 
students 


» 4 


1.M 


.50 


» 8 


3.16 


1.24 


» 5 


-1.87 


1.33 


K. Teacher evaluation 
procedures 


»14 


2.13"1.14 


• 9 


3.26 


1.24 


»13 


-1.12* 


1.72 


L Recognition for 
teacher achievement 


»12 


1.65 


.90 


«11 


3.42 


1.22 


t 6 


-1.81 


1.49 


M. Participation in 
making decisions 


tlO 


1.58 


.68 


»13 


3.51 


1.05 


t 4 


-1.92 


1.38 


N. Administrative support 
in improving student 
achievement 


» 3 


1.28 


.50 


t 5 


3.00 


1.23 


« 7 


-1.72 


1.29 



Note.- Teachers responded to each aspect In pairs according to the following format: 
Very important 1 2 3 4 5 Very (/nimportant 
Very satisfied 1 2 3 4 5 Very unsatisfied 



"Significant differences exist among school means at p < .05 
^Significant differences exist among school means at p < .01 
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their children's report cards; in addition, she and her staff also arranged pot luck 
suppers for adults in the evenings, and family day events on a Spring Saturday. 

All of the issues listed in section 17 on the teacher questionnaire were ones 
which teachers rated very highly for their importance to job satisfaction. On a scale 
ranging from 1 to 5, from very important to very unimportant, the means for ail txrt one 
item fell between 1 and 2, the top two points on the scale. The exception was for 
teacher evaluation procedures on which there was a significant difference among 
schools at p < .01 . As noted in Table 1 1 .3, School 4 teachers on average rated that 
aspect significantly less important (2.85) than Schools 1 , 2, and 3, whose means were 
1 .78, 2.07 and 1.78 respectively. Inten/iews v»nth School 4 teachers and administrators 
conveyed the sense that teachers there knew they were good; if they weren't they 
wouldn't be there; the principal would somehow have managed to get rid of them. 
Such a mindset would explain why teacher evaluation procedures were significantly 
less important to those teachers. 

How Satisfied Are Teachers with Aspects of Th«:>ir Jcb.«( 

If '3', the midpoint of the scale, represents neutrality, then teachers on average 
can be said to be reasonably satisfied about most aspects of their jobs. As revealed in 
Table 1 1 .2, almost all of the means for satisfaction scores fell within a half a score 
point (.5) of the midpoint on the scale. Again teachers were least satisfied with 
parent/teacher relationships, but dissatisfaction with participation in decision making 
ranked second from the t>ottom, with the smallest standard deviation. Teachers were 
uniformly less than satisfied with their level of participation in decision making. 

Significant differences among school means occurred for teacher/teacher 
relationships. Teachers in School 4 expressed significantly more satisfaction (a lower 
numerical mean) than teachers in the lower achieving schools. Schools 1 and 3. This 
came as no surprise to the investigators who had attended numerous duster and 
faculty meetings at the schools and had many occasions to observe the teachers 
relating to one another. Another significant difference occurred for teachers' 
satisfaction with their school's curricula; teachers in School 3 were significantly less 
satisfied than teachers in Schools 4, 1, and 2. These significant findings arc 
;>ummarized in Table 1 1.3. 
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TABLE 11.3 



Summary of Significant F Ratios from One-Way Analyses of Variance of Teacher 
Ratings of Importance of, and Satisfaction with, Various Aspects of Their Jobs 
And Duncan Tests of the Significance of Mean Differences Among Schools 



Aspects of Taachar'sJob Importance (I) 
Rated Hign (1 ) to Low (5) 



Satisfaction (S) 



Dlscrc:^'Jncy (I - S) 



F X Differances F X Differences F X Differences 



C. Levei of student 
achievement 



NS 



NS 



2.86* Sch 2.3 <4 



E TeacherAeacher 
relationships 



NS 



3.32" Sch 4 < 1.3 4.26" Sch 3.1 <4 



H. The curricula in 
school 



NS 



4.37"* Sch 4.1.2<3 5.05" Sch 3< 1.2.4 



K. Teacher evaluation 5.77" Sch 1.3.2<4 NS 
procedures 



3.1 r Sch 3.1 <4 



*p < .05 
"p < .01 

Note.-Lower means indicate higher levels of importance and satisfaction. 
t>ecause aspects were rated high (t) to low (5). Also, lower means indicate higher 
levels of discrepancy, because importance minus satisfaction produced negative 
results. 
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Discrepancy scores were computed by subtracting satisfaction scores from 
importance scores for each teacher in order to provide a gauge on the saliency of the 
issues as targets for change. All of the means for discrepancy scores were negative, 
because the means for importance of issues were doser to '1', the high point of the 
scale, where as means for satisfaction with those issues were closer to '3', the 
midpoint of the scale. In all cases the, teachers expressed greater importance for, 
than satisfaction wittn, the various aspects of their jobs. The greatest discrepancy was 
for parent/teacher relationships, as noted previously, but the second and third greatest 
were for job security and level of student achievement. Participation in decision 
making was fourth. School principals may well be advised to act on the fourth by 
involving teachers in planning sta-ategies and seeking their advice for improving levels 
of teacher satisfaction with the top three discrepant issues: parent/teacher 
relationships, job security, and student achievement. These will k>e discussed further 
in ttie section on teacher empowerment and staff development. 

Significant differences among schools occurred for four discrepancy scores, 
three on issues which had significant differences among schools in importance or 
satisfaction scores. There was significantiy less disaepancy (p < .05) between \he 
importance and satisfaction in levels of shxJent achievement reported by teachers in 
School 4 than teachers in Schools 2 and 3. Teachers in School 4 reported 
significantiy less discrepancy between importance and satisfaction on the issue of 
teacher/teacher relationships ttian teachers in Schools 3 and 1. This difference was 
significant at p < .01. On the issue of curricula in the school, teachers in Schools 4, 2, 
and 1 expressed significantiy less discrepancy t)etween importance and satisfaction 
witii \he issue than teachers in Sch'jd 3. Finally, there was less discrepancy between 
importance and satisfaction on ttie issue of teacher evaluation procedures for teachers 
in School 4 versus Schools 1 and 3. These school by school differences may be 
helpful to principals to establish normative comparisons on the salience of various 
issues for tiieir teachers versus teachers in other schools. 

Some Notes on the Use of Disaepancy Scores 

One might question whether the use of discrepancy scores is analogous to the 
use of gain scores, with Uie attending problem of inflated differences due to ttie 
unreliability of measurement. However, unlike pre-test and post-test achievement 
measures, tiie importance and satisfaction whidi teachers assign to various aspects of 
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their job were not expected to be correlated. Several teachers reporting on the clarity 
of the Ciuestions noted how helpful it was to have the dimensions separated. Having 
more unidimensional issues facilitated a 'cleaner' response. Importance and 
satisfaction were seen to require separate judgements. Correlation coefficients 
between the importance and satisfaction scores for each aspect of teachers' jobs 
cortfirmed this observation. Only three of the 1 4 coefficients exceeded . 1 5; these were 
.20 for level of student achievement, .26 for teacher/administrator relationships, and 
.22 for participation in making decisions. Most pairs con-elated less than .10, 
approaching 0.0% shared variance. 

Nonetheless, since the question of unreliability was important to ask, residuals 
were calcualted and the analyses of variance by school were run using residual 
scores, as they had been for discrepancy so^res. Significant differences among 
schools at p < .001 were found for residual scores between teachers' importance 
and satisfaction with teacher evaluation procedures. Just as the ANOVA for 
discrepancy scores had found, the difference clearly separated teachers in School 4 
from those in the other three schools. Teachers in School 4 were far more satisfied 
relative to the importance they placed on teacher evaluation procedures than were the 
teachers in Sdiools 1, 2, and 3. Analyses of residual scores did not produce 
significant differences for the other three variables which yielded significant 
differences when discrepancy scores were used (level of student achievement, 
teacher/teacher relationships, and the cunicula in school), although the trends were in 
the same direction. 

A final r.ote on the use of discrepancy scores is that their ease of computati'-n 
and conceptual understanding may facilitate the translation of research into practice. 
The discrepancy scores do appear to be useful to school personnel for arriving at a 
consensus on what priorities they target for reform. Arguably, interest in the utility of 
research should temper concern for methodological purity. 

Summary and Discussion 

Piecemeal prescriptions for school reform are not likely to succeed because 
they fail to address the problems in their complexity. While it is important to make the 
profession attractive to bright, talented, competent people, focusing efforts only on 
teacher preparation and licensure will be insufficient. The United States has the best 
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educated teaching force it is likely to have for years to come, simply t^ecause a lot of 
teachers preserrJy in the force had no real options when they made their career 
decisions. Now, equality of access to occupations means that sodety can no longer 
trap smart young t)iacks and women in teaching. The senior meml)ers of the teaching 
force will not be affected by changes in licensure, ar)d they are still many years from 
retirement. Staff development will be crucial to promoting and sustaining teacher 
competence for both new and veteran teachers, but up-to-date knowledge of subject 
matter and pedagogy should not be the only concerns. 

If academic excellence becomes the over-riding concern in teacher education, 
selection, and licensure education may stand to repeat the mistake of medicine in its 
single-minded pursuit of highly qualified applicants who test well and get good grades. 
By highly respected accounts, schools of medicine had managed to select and train 
the compassion right out of its medical students, undoing the very quality we want to 
see in doctors who treat ourselves and our families. Since then, medical education 
has developed many new programs to thwart the negative effects of severe 
competition for what can be more readily quantified-test scores and grades. 

Paradigms for research which have changed our thinking about how to study 
effective teaching and schooling call attention to v»rtiat actions teachers and others take 
to engage students and promote achievement, rather than what passive 
characteristics or credentials the teachers possess. But rather than being 'passive 
traits,' the value systems of teachers may be crucial for the central tasks of schools, 
although values alone are not sufficient. This hypothesis would be consistent with a 
major finding from the present study: what differentiates the performance of the 
highest achieving school from one v>/hich outwardly had more advantages was an 
ethic of caring. Both had high emphasis on achievement, but the more successful 
school was seen to be more collegial and cooperative by its teachers and by its 
students who also noted higher rates of prosodal behaviors in their midst. 

Asked what they liked most about teaching in their schools, teachers named first 
and foremost their students. This finding was con-oborated by results from tJie teacher 
questionnaire. One section contained 14 issues, presented in pairs, which inquired 
how important were various aspects of their job to job satisfaction, and how satisfied 
teachers were jn these issues. Teachers felt that teacher/pupil relationships were 
most important, and reportedly they were more satisfied with this aspect than any 
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other. Job seOiiity was the second most important concern, but among the least 
satisfied. Layoff notices have become a rite of spring which has taken on racial and 
ethnic overtones, since minority quotas continue to displace seniority as the basis for 
retention. Teacher performance is not considered in the dismissal process. 

Teacher <itings of importance averaged toward the high end of the scale, 
between the highest and second highest score points for all but one of the 14 aspects 
of their jobs which were included on the questionnaire. The exception was the issue 
of teacher evaluation procedures, which teachers in School 4 rated significantly less 
important than teachers in the other three schools. Interviews with teachers and 
administrators in School 4 suggested a mindset among those teachers that they knew 
they were competent; if they weren't they woukJn't be there. The principal would 
somehow have managed to get rid of them. 

Average ratings for teacher satisfaction with various aspects of their job were 
consistently lower than they were for importance of those issues, but if the midpoint of 
the scale represents neutrality, then teachers on average reportedly were reasonably 
satisfied about most aspects of tneir jobs. Significant differences among teachers in 
different schocis were found for two aspects, teacher/teacher relationships and the 
school's curricula. On collegial relationships, teachers in School 4 reported the more 
positive position than teachers in Schools 1 and 3; on the school's curricula, the 
teachers in Scf>ool 3 were significantly less satisfied than teachers in the other thr^^ - 
schools. 

Disaepancy scores were computed by subtracting satisfaction scores from 
importance scores for each teacher in order to provide a gauge on the saliency of the 
issues as targets for change. The discrepancy between job security and job 
satisfaction was second largest behind parent/teacher relationships. The discrepancy 
between the importance and satisfaction regarding the issue of salary ranked last out 
of fourteen issues. Simply stated, the issue of salary was not an issue for these 
teachers in comparison to other, more pressing needs. Teachers reflected third and 
fourth highest levels of concern over the level of student achievement and their own 
participation in decision making. School principals may well be advised to act on the 
fourth-ranked concern by involving teachers in planning strategies for responding to 
the top three issues: parent/teacher relationships, job security, and student 
achievement. 
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CHAPTER 12 



EMPOWERING TEACHERS WITHOUT LOSING SIGHT OF STUDENTS 

After sustained attention to the need for improving the quality and productivity of 
our nations schools, educational reform is at a crossroads. Either l&gislated 
prescriptions will continue to be imposed in the name of reform, or real reform might 
take hold through the empowerment of teachers. Wise (1979) warned about the 
dangers of legislation, centralization, and regulation to the education enterprise more 
than a decade ago. It would be a 'world characterized by standardized testing, not 
educational standards: by teacher-proof curricula, not curricular reform: by 
standardized teaching, not professional disaetion; and by management-by-numbers, 
not instructional leadership." Where are we now? The picture complicated. 
Revisiting legislated learning. Wise (1988) cites two conflicting trends which have 
been evident in the past decade. One is the continuing effort by the states to 
consolidate control: the other is the return to the classical conservative view that 
educational decisions are best made closest to the people served. 



A Crossroads for Both Educational Reform and the Teaching Profession 

Not only is educational refomfi at a crossroads. Wise's colleague, Darling- 
Hammond (1988) argues that the teaching profession in America is at a crossroads. 
One path reflects the assembly line point of view in which teachers must administer 
fixed procedures (schedules, curricula, placement and exit tests), using the tools that 
are given them (textbooks and limited other material), while administrators enforce 
rules, inspect performance, and maximize efficiency. The alternative path starts from 
the assumption that students are not standardized, and teaching is not routine. It 
follows that teachers must exercise judgments repeatedly, based on knowledge of 
learning theory and pedagogy, curriculum, and assessment, as well as suksject matter. 

The empowerment of teachers as the most promising strategy for reform goes 
hand-in-hand with the transformation of teaching into a true profession. But, as it was 
argued in the previous chapter, changes in teacher preparation, while they are part of 
the solution, will not be sufficient by themselves. Participatory management and staff 
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development must take place alongside strurturai changes in the way schools operate 
in order to promote collaboraticn among teachers and provide opportunities for 
continual reform from within. These strategies will t>e important not only ^o attract 
talented, dedicated people but to sustain them in a professional work env onment. 
What is coming into focus is that legislated standards and piecemeal refc -ms won't 
work, and that reforms which lose sight of students will also miss the mark. 

Learning from the Past But Looking to the Future 

The Carnegie Task Force on Teaching as a Profession cautioned that we are 
doing tetter on the old goals at the expense of making progress on what counts most. 
'Because we have defined the problem of schools in terms of decline from earlier 
standards, we have unwittingly chosen to face backwards when it is essential that we 
face fooArard' (1986, p. 20). Building on tNs metaphor, Mk:haels urges that we 'take 
our eyes off the rearview mirror of first wave reform and look carefully at the 21st 
century.' The first wave set out to raise standards, increase r.ocountability, and raise 
rigor. The second wave is more enlightened, marked by a different and exciting 
agenda: participatory school-based management; cooperative, collegial school 
environments for both students and staff; flexible use of time; high expectations 
alongside an eti-iic of caring; cunicula that focus on students' understanding, not only 
of what, but also their understanding of why and how; as well as an emphasis on 
highei order thinking and complex problem solving for all students. 

Direction from Research 

Cuban (1990) offers a penetrating analysis of wh> refomns recur-again, and 
again, and again-using pendulum swings and cycles as images to illustrate the 
periods return of numerous reforms Political processes, conflwting values, economic 
conditions, and reigning ideologies fuel innovations which tinker with the system but 
leave untouched the '-egularities of schooling, failing to change in a fundamental way 
how schools operate, '...few reforms aimed at the classroom make it past the door 
permanently' (1990, p.11). 

Slavin discusses the dynamics of the educational oendulum using the Madeline 
Hunter phenomenon as a case in point. 'Nineteen years after the Hunter 
phenomenon began in earnest, a high-quality, large scale evaluation of ITIP has 
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appeared' (1989, p. 754). (ITIP refers to Hunter's popular educational training model 
called Instnjctional Theoiy into Practice.) Results were mixed at best. In Slavin's view, 
two major shifts will have to take place if we are to wean ourselves from faddism and 
increase the chances for lasting change: 

First, school districts will have to demand high-quality evrluations of 
programs before they adopt them... .Second, school districts will have to 
focus their staff development efforts not on one-shot workshops, but on 
extended training and fpllowup for a smaller number of programs of proven 
effectiveness. The emphasis in staff development must shift from scattershot 
presentations on what's new to systematic implementation of what works 
(Slavin. 1989, p 757). 

Not only are faddism, political pressures, and reigning Ideologies getting in the 
way of sustained reform, rationalized reforms can also be misguided. Cut in (1990, p. 
5) decries the common practice of 'rational explanation bashing' used as a preface by 
those who think their own favored explanation will convince the audience. The 
rational model of organizational change is pen/asive, particularly among policymakers 
and administrators. The problem is that what stands to reason doesn't always work. 
State-mandated competency testing is a case In point. Rather than raising standards, 
it has depressed them to what is measurable. 

Effective solutions are sometimes counterintuitive. In addition, for problems as 
complex and long entrencht*^ as the ills of uriDan public schooling, solutions will have 
to be corrprehensive and nandfaceted, rooted in research eviderx;e synthesized from 
many sources. Scheerens (1989) has attempte d sucn an Integrative model; It Is 
systems oriented, embodies a multilevel framework, and contains sut>stantlve findings 
from different types of educational effectiveness research. 

The second wave of refonm calls for restructuring schools In pervasive ways: 
changing the use of time and space; making schedules more flexible; altering the 
allocation of resources; rethinking the roles professional personnel assume. 
Introducing more para-professionais and other professionals, sucn as social workers, 
health experts, and counselors. But In all of this, the role c' the teacher is central, 
because teachers ara the basis of schooling (Maeroff, 1989) and the engagement of 
student learning is their central task (Newmann, 1987). Participatory decision making 
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through school based management is a strategy for reform which can enable 
structural changes to reacf ^ the student. 

Participatory Decision Making 

If bureaucratic control over resources is moved from a district to a school level, 
where a single individual-the principal-makes the decisions bureaucratically, not 
much will change in the classroom. If schools restructure themselves by changing 
fixed rows of desks into clusters and call it coooerative learning, if they alter the length 
of class periods a bit and call it flexible scheduling, or they rotate teachers thronqh 
lectures and call it team teaching, nothing will change ultimately. More than tlu 
is needed; neither is the locus of decision making the key issue. Principal; ^ 
testch^rs need to participate in dedsions to affect what teachers do in the classroom 

This conception of school-t>ased management requires a structure for decisinf. 
rr:iking in ./hich teachers kjentify problems, propose tentative solutions, and identify 
ttie resources needed to try them out. Team leaders, duster coordinators, department 
heads, and assistant principals might serve as the advocates and negotiators for their 
teams of teachers. Principals must make the decisions on ttie acquisition and 
allocation of resources, while serving as the school's advocate to upper echelons of 
ttie system. 

Teachers as Professionals 

This participatory role for teachers in decision making at tiie site level requires 
ttiat administi^ators recognize teachers as professionals who aru trained to cope witii 
uncertainty (Backarach & Conley, 1986) and who make scores of nontrivial decisions 
in the space of a single lesson (Beriiner, 1984). Administrators must view teachers 
not as assembly line woricers following fixed procedures, announcers following a 
script, or paper pushers keeping ti^ack, but as decision makers and profc>lem solvers- 
ti-ue professionals who continuously refine and adapt their pedagogical knowledge to 
new situations and changing needs of stijdents. 

There has been conskjerable debate over wNch kinds of dedsions teachers 
want to influence. Some researchers have found it stiiking how much teachers lack 
interest in major policy decisions, like budget, curriculum, and new programs 
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(Firestone & Rosenblum, 1988). Teachers may be willing to forego participation in 
majo<- policy decisions because they take time from teaching (Ccrbctt, Dawson i 
Firestone, 1984). Research indicates that teachers want the greatest influence over 
operational classroom decisions including what to teach, how to teach and what 
textbooks to use(Mohrman, Cooke, & Mohmian, 1978; Backarach, Bauer, & Conley, 
1986; Shedd, 1988). It would seem that day-to-day decisions rather than strategic 
chotees are most important, but salience may be a factor teachers are usually more 
concerned about budgets when they do not get the s^jpplies they need. 

Reporte<jly the decisions in which teachers feel most deprived are those wi lich 
affect the boundary between the classroom and the school, which constrain teachers' 
decision making. These issues include student placement and promotion, rules of 
discipline and their enforcement, teachers' course assignments and schedules 
(Conley, 1988). Indeed, some of the greatest constraints on classroom practice may 
occur at the district level (Shedd, 1988). The critical factor may be the individual's 
sense of control over one's own work. Indivkiuals demonstrate greater commitment to 
jobs that give them autonomy and disaetion, in part because they have a sense of 
making a greater contribution to the organization (Steers, 1977). 

The debate over which decisions teachers want to make and ought to make 
may stem from different points of view on what constitutes their professional identity 
and expertise. Secondary school teachers may view their expertise more in terms of 
subject matter and may want to participate in curricular decisions at the district level; in 
contrast, elementary school teachers may view their expertise more in terms of their 
clientele and want to devote more time to intraorganizational issues which may 
address students' needs. Whatever the decisions which they are empowered to make, 
to do so effectively teachers need good intomnation, not only from their own 
professional insights and considerable experience in their schools, but from research, 
including participatory research. 

Teachers as Researchers 

Good (1989) argues for the linking of research on Uacher effectiveness to the 
research on effective schools, and especially for the involvement of teachers as 
researchers in this integration. Practitioners have not had a voice in setting the 
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research agenda for education, which may explain in part why so little research gets 
translated into practice and used in the classroom. The American Educational 
Research Association called attention to this problem when it established 
collaboration between researchers and practitioners as the theme for its 1987 Annual 
Meeting. The situation is changing, as Lieberman notes (1988), especially as 
teachers are being asked about their new roles and relationships in school reforms, 
and what organizational changes appear necessary to complement these changes. 

Cochran-Smith and Lytle say that little attention has been given by academic 
researchers ic the roles teachers might play in generating a knowledge base about 
teaching. 'What is missing...are the voices of the teachers themselves, the questions 
they ask, ...and the interpretive frames teachers use to understarxJ and improve their 
0VW1 classroom practices' (1990, p. 2). From their perspective as university-based 
teacher educators and researchers, the authors charge that both of the paradigms 
which >^ave dominated research on teaching over the last two decades- especially 
process-product research, but also qualitative, interpretative studies-have constrained 
and, at times, even made invisible, teachers' roles in the generation of knowledge 
akx)ut teaching and learning in the classroom. 

The experience of the present study has been different. The research was 
collaborative from the start, with practitioners, especially teachers, contributing to the 
creation of instruments and critiquing successive drafts. On the occasions when 
teachers were presented with summaries of questionnaire data from their ovv.i schools 
with district wide summaries for reference, the tfe?chers engaged in animated, task 
oriented discussion and critique of their own schools. Posturing and argument over 
the present status of issues, as ot>served in so many previous discussions, seemed to 
give way to an energized exchange of kieas on what they might change, and v«^at 
positive results they should sustain as a reflection of good practice. 

Unfortunately, we could not continue this level of collaboration, because new 
sources of support could not be obtained to pursue the next critical step-b-anslating 
research into practice. Despite the substantial gains in the knowledge about what 
constitutes an effective school, much less is known about how to use this infomnation 
for school improvement. A fuller investigation is needed of ttie processes by which 
schools inaease, decrease, or maintain effectiveness. Efforts have been mounted by 
a number of school disti'ids to implement projects based on models of effective 
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schools, but information is lacking on the procedures followed, the obstacles 
encountered, and the results, both positive and negative, intended and unintended. 
Thus, the literature is increasingly dear about what effective schools are like, but not at 
all dear on how to get there. Several proposals to conduct research on the translation 
process had been submitted to different agendes and foundations, unsuccessfully. 
What follows here are the results of the instruments which teachers helped tc create, 
and how practitioners might use these results to bring about school reform. 

Indicators to Guide the Process of Reform 

The point of departure for the present study has been that school effectiveness 
has been measured too nan-owly, by standardized tests of basic skills for the most 
part. It is important to assess other outcomes, such as performance on tasks of 
complex problem solving, creative endeavors, and prosocial behaviors, if we want 
schools to strive for more. It is also important that educators examine carefully the 
inputs and the processes of schooling, in order to make informed decisions about 
which reforms to undertake and how to proceed. The present study considered 
demography characteristics of students and teachers, what values students hold, and 
what is important and satisfying to teachers might be considered indicators of inputs. 
We also developed process indicators which might be used to guide restructuring, 
help partidpants estat)lish priorities, and identify strategies for change. 

Teachers' Areas of Influence 

As noted eariier in this chapter, research has indicated that teachers want the 
greatest influence over operational dassroom dedsions induding what to teach, how 
to teach, and what textkxsoks to use. But the dedsions over which teachers feel most 
deprived are those which affect the boundary between the dassroom and the school, 
which constrain their dedsion making, including dedsions on student placement and 
promotion, teaching schedules, and course assignments. The items in Section 14 of 
the Teacher Questionnaire were developed to assess teachers' perceptions of how 
much say they have in 25 areas of influence. Their responses are summarized as 
percentage distributions in Table 12.1. Means, overall rank order, and school 
differences in means for each of the areas are summarized in Table 12.2. 
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TABLE 12.1 

Percentage Distribution of Responses to Items on Teacher's Areas of Influence 



How much say do you have in Does not 
determining the following issues? apply 


A tot 




1 a i_M_llMA-L 

ModorsiB 




None 


A. 


Your teaching schedule 


05.4 


08.7 


04.3 


4 O A 

1 2.0 


4 A O 
10.9 


CO 7 
90. f 


B. 


Your room assignment 


08.7 


Q2.2 


A ^ ^ 

04.3 


4 O A 
1 2.0 


AC e 

00. 9 


CC ^ 

00. o 


C. 


Your cluster or team assignment 


12.4 


4 A 4 

10.1 


AO O 

02.2 


4 0^ 

1 £.4 


AC 7 
00. f 


Cf% 9 
90. £ 


D. 


Your cluster's (team's) leader 


11.2 


09.0 


A ^ C 

04.5 


AC *7 

06.7 


AC 7 
00. f 


CI A 
01 .0 


E. 


What courses you teach 


10.0 


16.7 


08.9 


14.4 


AC 7 

06.7 


AO O 

43.3 


F. 


Which ability levels you teach 


13.3 


05.6 


06.7 


4 O O 

1 2.2 


4 A A 
10.0 


C9 9 


G. 


What content you teach 


10.2 


31.8 


14.8 


4 ^ a 

14.8 


r\A e 
04.9 


9^ O 
£9.9 


H. 


What instnjctionai objectives are set 


03.4 


37.1 


4 C A 

1 6.9 


4 O A 
18.0 


AC 7 

00. r 


1 fl ft 

1 o.o 


1. 


What teacNng methods you use 


04.4 


73. D 


4 ^ O 

1 4.3 


rxA A 
U4.4 


ft 4 1 


ft9 9 


J. 


What textbooks you use 


05.6 


OA A 

20.0 


AT O 

07.8 




i 7 fl 


9ft Q 


K. 


What other materials you use 


02.2 


56.2 


4 a A 

18.0 


4 4 O 
1 1.£ 


ftC c 
09.0 


ft*5 7 
UO. r 


L. 


What standardized tests are given 


12.4 


U4.0 


A AA 


UD. f 


l'4.9 


71 Q 

f 1 .9 


M. 


What informal tests are given 


04.6 


fiA Q 

DU.9 


17 0 


0*^ A 
U0.4 




IIS 
1 1 .9 


N. 


What stuaent grades are assigned 


03.4 


99.1 


1 O.w 


t\7 Q 
U r .9 


ft^ K 


1 9. t 


0. 


Whether students are promoted 


02.2 




OA 0 






9*5 1 


P. 


How students are placed 


03.3 


4 4 A 

1 1.U 


1 5.4 


OQ 7 


1^0 


97 C 


Q. 


How teachers are evaluated 


05.6 


AO O 

02.2 


A 4 4 
01.1 


AA A 
00.0 


119 


7Q A 
f 9.0 


R. 


Who evaluates you 


03.3 


AO O 

U2.£ 


A 4 4 
U 1 .1 


uu.u 


ft7 7 


AS 7 
09. r 


S. 


When your classes are ot)served 


06.7 


02.2 


04.4 


23.3 


15.6 


47.8 


T. 


What staff development takes place 


05.7 


04.6 


05.7 


17.2 


21.fl 


44.8 


U. 


Which teachers serve on committees 


06.7 


04.5 


07.9 


33.7 


15.7 


31.5 


V. 


Which teachiers attend conferences 


05.6 


01.1 


02.2 


21.3 


09.0 


60.7 


W. 


How inservice days are used 


00.0 


02.2 


05.5 


15.4 


18.7 


58.2 


X. 


How professk>nai days are used 


01.1 


04.4 


05.5 


13.2 


09.9 


65.9 


Y. 


How school budgets are spent 


02.2 


01.1 


01.1 


06.6 


05.5 


83.5 
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Table 12.2 

Rank Ordar. Maans and Standard Oaviationa and Sunrvnary of ANOVA Results by School 
For Teachars' Parceptiora of Their Influence on Varioua Issues 



25 Issues Rated Hi (1)10 Low (5) %No Summary fbrM-Four Schools School 

on Degree of Teacher Influence Opinion Rani( X s Differences 



A. 


Your tMcNng schedule 


05.4 


#15 


4.13 


1.33 




B. 


Your room «ssHjn.Tient 


08.7 


•21 


4.43 


1.04 




C. 


Your duster or team assignment 


12.4 


#14 


4.10 


1.39 




D. 


Your cluster's (team's) leader 


11.2 


#17 


4.23" 


1.37 


1.3<4.2 


E. 


What courses you teach 


10.0 


#10 


3.57 


1.60 




F. 


Which ability levels you teach 


13.3 


#15 


4.12 


1.28 




G. 


What content you teach 


10.2 


# 6 


2.71 


1.63 




H. 


What Instnjctional objectives are set 


03.4 


# 5 


2.50 


1.52 




1. 


What teacNng methods you use 


04.4 


# 1 


1.37 


.82 




J. 


What textbooks you use 


05.6 


# 8 


3.29 


1.51 




K. 


What other materials you use 


02.2 


# 3 


1.86 


1.24 




L. 


What standardized tests are given 


12.4 


#22 


4.59 


1.01 




M. 


What informal tests are given 


04.6 


# 2 


1.81 


1.36 




N. 


What student grades are assigned 


03.4 


» 4 


2.09 


1.52 




0. 


Whether students are promoted 


02.2 


# 7 


3.08 


1.37 




P. 


How students are placed 


03.3 


# 9 


3.32" 


1.31 


K4.3.2 


Q. 


How teachers are evaluated 


05.6 


#24 


4.75 


.74 




o 

n. 


auttli lA^Att um 1 

vvno Bvajusxoa yuu 


03 3 


#25 


4 80 


.71 




s. 


When your classes are observed 


06.7 


#14 


4.10" 


1.08 


4.K2 


T. 


What staff developn>ent takes place 


05.7 


#12 


4.02 


1.17 




U. 


Which teachers serve on committees 


06.7 


#11 


3.66" 


1.17 


4<1,3 


V. 


Which teachers attend conferences 


05.6 


#20 


4.33 


.99 




w. 


How Inservice days are used 


00.0 


#18 


4.25 


1.05 




X. 


How professkinal days are used 


01.1 


#19 


4 29 


1 16 




Y. 


How school budgets are spent 


02.2 


#23 


4.73" 


.73 


1<3 



"Signifies significant differences among school means at p < .05 
""Signifies significant differences anK>ng school means at p < .01 
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The distributions of percentages of teachers choosing each option to each item 
show striking skewness; either teachers feel they have a lot of say over a given issue 
or almost none. Very few distributions reflect a middle range of influence. This 
observation is corroborated by the means reported in Table 12.2. Not surprisingly, 
teachers say they have greatest control over their own teaching methods; the second 
and third highest areas of influence have means which cluster about one-half of a 
scale value away indicating somewhat lesser influence o^er what informal tests are 
given, what supplementary materials they use, followed by the fourth ranked mean for 
what student grades are assigned. Means ranging from 2.5 to 3.1 indicating a 
moderate level of influence are reported for the items on what instructional ot)jectives 
are set, what content they teach, and whether students are promoted, which ranked 
fifth, sixth, and seventh respectively in degree of teacher perception of influence. 

More than half of the areas (14 out of 25) received mean ratings by teachers 
which were in excess of 4.0 on a five point scale, where a '5' meant no influence, 
indicating the teachers feel they have very littie if any say about many areas related to 
their work. What is especially striking is that teachers report having even less 
influence over how they are evaluated and who evaluates them than they do over 
budgets and what standardized tests are given in the system, and, perception not 
withstanding, it is affirmed that in fact teachers have no say on budgets or 
standardized tests. 

Factor analyses were used to determine if a smaller number of underiying 
dusters could account for these 25 items. Since the number of teacher respondents 
was only 92, the items were sorted into two sets for separate factor analyses. The 
sorting was done by three referees who assigned the items into two groups by content: 
those regarding professional issues, and ihose which dealt with pupil and curricular 
issues. Few disagreement arose, and these were resolved by consensus. The results 
for each analyses are given in Tables 12.3 and 12.4. 

Factor analysis of teacners' perceptions of their influence regarding 
professional issues yielded three significant factors; together they accountec* for 
69.2% of the variance. As reported in Table 12.3, the factors separated these items 
according to the locus of decision-making: the items on Factor 1 dealt with decisions 
made at the school level; the items on Factor 2 included issues which were addressed 
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TABLE 12.3 



Results of Factor Analysis of 13 Items on Teachers' Influence in 
Decisions Regarding Professional Issues 



Factor Numkser 
&Nanr» 



Item 



Weight 



Eigen- 
value 



Pet of 
Var 



Cum 
Pet 



School Level 
Decisions 



5.87 



45.1 



45.1 



Q. Taachm' evaluation .80 
R. Whosvaluatas .77 
S. Whanobsarvad .66 
T. What staff davalopmant .76 
U. Who on committaaa .79 
V. Who to confarancaa .78 



2: Classroom/Cluster 
Level Decisions 



1.67 



12.8 



58.0 



A. Teaching schadule .78 

B. Room assignment .74 

C. duster assignment .85 

D. Team leader .85 



System Level 
Decisions 



1.46 



11.2 



69.2 



W. Insen/ice days .89 
X Professionai days .76 
Y. Budgets .60 
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TABLE 12.4 



Results of Factor Analysis of 12 Items on Teachers' Influence in 
Decisions Regaruing Pupil and Curicuiar Issues 



Factor NumtMr 
&Name 



Item 



Weight Eigen- Pet of Cum 
value Var Pet 



1: System-wide 
Curriculum 



3.50 



29.2 29.2 



H. Instructional objactiws .74 

I. Taaching mathods .50 
J. Taxtbooks .78 
L Standardlzad tasts .71 



2: School Cuniculum 



E. Couraaa you taach .77 

F. AblNtylavals you taach .85 

G. Contant you taach .84 



1.73 



14.4 



43.6 



3: Sivident Placements 



1.40 



11.7 



55.2 



N. Studant gradas .46 
O. Studant promotlona .84 
P. Studant placamants .77 



4: Classroom Level 
Issues 



1.09 



9.1 



64.3 



K. OVfm matariais 
M. Informal 



.56 
.82 
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at the dassroom or duster level; and the Items on Fador 3 were dedsions made at the 
system level. 1'he separations were very 'dean,' with item weights ranging from .60 to 
as high as .89, only a few in the .30-.3S range, and the vast majority much lower. 
One-way analyses of variance t)y school conducted for each of the three fador scores 
produced no significant results. 

Fador analysis of the items asking teachers about their influence in dedsions 
on student and cunicular issues produced four significant fadors accounting for 
64.3% of the variance. As reported in Table 12.4, iterrts on Fadors 1 through 4 dealt 
respectively with system-wide cumcular Issues, the school's curriculum, student 
promotion and placement, and dassroom level issues. However, Fador 1 joined 
items on instructional objectives and teaching methods, which one might exped the 
teacher to contrd, with items on the selection of textt)ooks and choice of standardized 
tests which in the Boston Public School are unequivocally decisions made at tho 
central level. What would explain the duster, which is based on empirical congelation, 
is that teachers feel they must teach to the te;>t, and spedfically the Metropolitan 
Reading Test and the Harcourt Brace Janovich Unit Tests from their basal reading 
series. It would appear from the fador analyses, the only dedsions which teachers 
make independently relate to the supplementary materials they use in teaching and 
the informal tests they give. Once again, ANOVA's of fador scores produced no 
significant differences among the four schools. 

Fadors Affecting the School's Curriculum and Teachers' Objectives 

In light of the research indicating that teachers want to make those decisions 
that have dired influence on their classroom teaching, it was dncided to create 
separate sets of Items to check teachers' perceptions of influences on cuniculum at the 
school level which border on dassroom practice, as well as fadors determining what 
objective teachers set for their own students. The former were assessed in Section 
16, Items A-Q of the Teacher Questionnaire; the latter in Section 20, Items A-G. Table 
12.5 contains the percentage distributions of teachers' responses to items regarding 
their perceptions of influences on the school's curriculum, while Table 12.6 contains 
the results of fador analyses of those items. Tables 12.7 and 12.8 contain the 
corresponding results for items on teachers' perceptions of fadors which determine 
their own teaching objectives. 
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TABLE 12.5 



Percentage Distribution of Teachers' Responses to Items Regarding 
Their Perceptions of Influence on the School's Curriculum 



OegrM of fofluane* Mch over daclalont 
•bout ttw achooTs curriouium 


atat 




sofnB 


Almost 

none 


A. 


Individual teachers 




02.2 


10.1 


28.1 21.3 


38.2 


B. 


Groups or dusters of teachers 


03.3 


*3.3 


36.7 20.0 


26.7 


C. 


Principal 




33.0 


28.4 


13.6 12.5 


12.5 


0. 


Tradition 




22.9 


22.9 


27.7 10.8 


15.7 


E. 


District level administrators 




34.9 


21.7 


15.7 08.4 


19.3 


F. 


Ceniral office administratois 


45.2 


14.3 


14.3 06.0 


20.2 


G. 


School committee 




34.9 


20.5 


15.7 04.8 


24.1 






TABLE 12.6 










Results of Factor Analysis of Seven Items Regarding Teachers' Perceptions 
Of Factors or Groups Which Influence the School's Curriculum 


Factor Number 
&Name 


Item 


Weight 


Eigen- 
value 


Pet of 
Var 


Cum 
Pet 


1: 


They Oedde 


Principal 
Tradition 
District Admin. 
Central Admin. 
School Comm. 


.71 
.62 
.90 
.92 
.83 


3.42 


48.9 


48.9 


2: 


We Decide 


Individual Ts 
Grcips of Ts 


.86 
.89 


1.90 


27.2 


76.1 
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TABLE 12.7 



Percentage Distribution of Teachers' Responses to Items Regarding 
Their Perceptions of Factors Which Influence Teaching Objectives 



ImportanM of Mch factor In <tet«rmir^ 
iMChing obj«ctivM for your students 


very 

important 




aonwMwt 
Irrportant 




wBry 
urimportvt 


A. School DoUcv 


aB.1 




303 


12.4 


075 


B. Studtnt Interest 


422 


31.1 


157 


lao 


X.0 


C. Individual student ability 


57.1 


31.9 


07.7 


oa3 


X.0 


0. Your personal preference 


1&9 


293 


39.8 


11.4 


oa4 


E Available tK(tt)ooks 


42.7 


23.6 


1&7 


iai 


075 


F. Other available resources 


3&6 


23.9 


26l1 


06£ 


043 


a What win be tested 


21.6 


25.0 


3Sl2 


06.7 


123 



TABLE 12.8 



Results of Factor Analysis of Seven Items Regarding Teachers' Perceptions 
Of Factors Which Influence Their Teaching Otsjectives 



Factor Number 
&Name 


Item 


Weight 


Eigen- 
value 


Pet of 
Var 


Cum 
Pet 


1: Practical/Actual 


Student ability 
Available texts 
Other resources 
What is tested 


.50 
.85 
.65 
.61 


2.66 


28.0 


38.0 


2: Theoretical/ldeai 






1.04 


14.9 


52.9 




School policy .65 
Student interest .67 
Teacher preference 70 
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The distributions of percentages in Table 12.5 are very skewed; the first two 
rows of percentages indicate that the teachers felt they and their colleagues had very 
little influence on the school's curriculum. In contrast, the last five rows show higher 
percentages toward the direction of much influence, which they attribute to 
administrators, the school committee (which is factually arguable), and tradition. The 
results of factor analysis in Table 12.6 confirm this, yielding a 'we-they' split. 

As shown in Table 12.7, teachers rated their own personal preferences as least 
important, and school policy only slightly higher. Teachers rated individual student 
ability as the most important, yet, as shown in Table 12.8, these three items fell 
together on the second factor, distinct from the remaining four which weighted on the 
first factor. What appears to separate the two groups of items is the distinction 
t>etween practical or actual influences on objectives which cor>tribute to Factor 1, as 
opposed to theoretical or ideal considerations which comprise Factor 2. 

Meeting Student NecKis: Assessing Accomplishments and Setting Priorities 

Section 18 on the Teacher Questionnaire comprised a very long set of items 
given in two parts. Teachers were asked to indicate for each of 31 areas first, how 
successful their school has been with regard to meeting student needs, and second, 
what priority their school shouki place on that area. Teachers were instructed to leave 
the item tsiank if they had no opinion. Percentage distributions of their responses to 
these items are given in Table 12.9. The rank order, means and the standard 
deviations for each item are given in Table 12.10. Discrepancy scores were 
calculated by subtracting teacher ratings for the priority they would assign to a given 
item from their estimate of the success which their school had achieved. The 
discrepancy scores are designed to indicate the salience or importance of each area 
need. 



The overall mean for the four schools would indicate that teachars assess their 
greatest success to be in the area of teaching computer skills. However, a highly 
significant difference among the school means was found for this item. As indicated in 
Table 12.1 1. the great success in teaching computer skills was reported by teachers in 
School 4, whose mean reflected neariy twk:e the level of success reported by teachers 
in the other three schools. The outcome was not surprising because for years the 
former principal of School 4 had been writing proposals and winning support and 
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equipment for computer environments in that school. Analysis of the discrepancy 
scores fc this area also produced a ^ery significant difference among schools. 
Inspection of the means showed that teachers in School 4 felt their school had been 
so successful in teaching computer skills that it exceeded the priority which should be 
assigned to that area, 't was the only case in the 31-item set for which a negative 
mean value was ot>tained for a discrepancy score. As an overall school mean, it 
ranked dead last in terms of needs to address. But again, since highly significant 
differences were found, individual school means shouki be examined. 

In the area of bilingual education, significant differences were found among 
schools for both the success and the priority assigned. On both measures, teachers in 
Schools 1 and 2, which have bicingual programs, offered more positive ratings than 
teachers in Schools 3 and 4, which do not. However, since the discrepancies were 
minimal, bilingual education was an area rated second to last for warranting attention, 
for all four schools. 

Several of the more successful efforts by the schools, which were noteworthy 
from the teachers' point of view, dealt with ^oe^ actional needs and values: aeating 
a caring environment, showing concern for students' personal needs, and providing 
positive role models, which ranked second, fourth, and fifth, respectively. Teaching 
special education ranked third among teacher estimates of success; all four schools 
had a substantial number of their students in seme form of special education program. 
The low ranking for discrepancy suggests that special education may be 
overemphasized, or that the schools' emphasis is balanced on that issue. Teachers 
judge their schools to be least successful in providing pregnancy counseling, teaching 
art and music, sex education, and occupational counseling, which rank in ascending 
order from the bottom. But while they feel they are not successful in these areas, 
teachers do not assign high priority to some of the areas, and they differ by school in 
their assignment of priorities to others of tiiese issues, notably teaching art and music, 
and providing occupational counseling, so school level decisions appear to be 
important. 
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TABLE 12.9 



Parc«ntag« Distribution of TMchars' RMponsos to Itomt Rog vding IHow SuccossftJl Thoir School Has Baen In 
miMting Studant NMds in Varioua Araas, and What Priority Should Ba Placad on Thosa Araas 



A. 


Teaching basic Hleracy sMIb 


vary Aiccassfui 

Ngh priority 


11.4 
7Z1 


2a9 

ia6 


455 

06.8 


12.5 
023 


C*j5 
012 


vary unsuccessful 
low priority 


B. 


TeacNng writing 
aach cat-fniasing 7 


vary succeasfui 
Ngh priority 


11.8 
6&9 


22.4 

2ao 


44.7 
062 


14.1 
035 


07.1 
02.4 


vary unsuccessful 
iowf priority 


C. 


TaacNng mathamatics 
aach cat-fnissing 10 


vary succeasfui 
Ngh priority 


2a7 
69.5 


22.0 
232 


42.7 
0&1 


Q9£ 
012 


04S 

oao 


vary unsuccessful 
low priority 


D. 


TaacNng adanca 
auc-miaa 12« pri-miss 11 


very successful 
Ngh priority 


lao 


ZTL 
2a4 


412 

222 


10.0 
07.4 


112 
012 


vary unsuccessful 
iow priority 


E. 


TaacNng social studias 
suc*fnisa 12, pri-misa 13 


vary successful 
Ngh priority 


ISO 
41.8 


jao 

319 


3&0 
203 


ia7 

025 


065 
025 


vary unsuccessful 
low priority 


F. 


TaacNng computar aWlls 
sirj-fnisa IS, prt-fniss 16 


vary successful 
Ngh priority 


3a4 

39.5 


19£ 

3Su5 


312 
17.1 


10.4 
07S 


02.6 

oao 


vary unsuccessful 
low priority 


G. 


Teaching tNnWng aldlls 
suc-misa 10, pri-misa 9 


vary successful 
Ngh priority 


14.6 
63.9 


15.9 
16S 


2&8 

oa4 


265 
072 


15S 
035 


vary unsuccessful 
low priority 


H. 


Teaching bHingual education 
each catHtiissing 32 


very auccaasful 
Ngh priority 


21.7 
3S.0 


21.7 
1&3 


30l0 
21.7 


10.0 
10.0 


ia7 
lao 


vary urvHJccessful 
low priority 


1. 


Teaching special education 
suc-misa 14, pri-miaa 13 


vary succa&sftjl 
Ngh priority 


21.8 
SS.7 


3&5 
24.1 


282 
152 


06.1 
05.1 


oa4 

oao 


vary unsuccessful 
low priority 


J. 


TeacNng multicultural education 
suc-m^ 17, pri-misa IS 


vary aucceasflil 
Ngh priority 


13L3 
3Sl1 


22.7 
25.7 


sao 

21.6 


14.7 
095 


135 

oai 


vary unsuccessful 
low priority 


K. 


TeacN ig art and music 
suc-miss 19, pri-miaa 21 


vary succesishii 
Ngh priority 


06.5 
26i8 


\2Z 
21.1 


2&0 
^4 


192 
025 


37.0 

ia9 


vary unsuccessful 
low priority 


L 


Teaching the gifted and talented 
suc-miss 20, pri-miaa 19 


very successful 
Ngh priority 


12^ 
342 


292 
32.9 


15.3 


23.6 
04.1 


19.4 
082 


vary uns^^ccessful 
low priority 


M. 


TeacNng moral/ethical values 
suc-miss 14, pri-misa 13 


very successful 
Ngh priority 


14.1 
4&8 


10.3 
152 


24.4 

253 


23.1 
065 


282 
065 


vary unsuccessful 
low priority 


N. 


TeacNng social courtesies 
each cat-missir>g 12 


very successful 
Ngh pnorlty 


lao 

4&0 


lao 


AJJU 


225 


275 
uo^ 


vary unsuccessful 
lOV/ pnonvy 


0. 


Promoting students self esteem 
suc-miss 9 


vary succassful 
Ngh priority 


1S7 
59.3 


21.7 

ia6 


36.1 
17.4 


195 
035 


072 
012 


very unsuccessful 
low priority 


P. 


Providing occupational 
counseling 

suc-miss 19, pri nniss 18 


vary auccassAil 
Ngh priority 


06.2 
29.7 


09.6 
23.0 


X.1 
27.0 


26.0 
122 


26.0 

oai 


vary unsuccessful 
low priority 


0. 


Providing educational 

counseling 

each cat-missirHl 16 


vary succassful 
Ngh priority 


075 

3a2 


27.6 
31.6 


25X) 
1&B 


19.7 
105 


19.7 
03S 


vary unsuccessful 
low priority 
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Tabl« 12.9 (cont) 



R. Making roorrtt/corridors 



wry succMsrftJl 216 
highprlorlty 409 



27.0 2ai iai 112 vary unsuccessful 
33L0 ia2 0a4 045 towprtorlty 



S. Providing gsnaral hMlth 
education 

suo-min 12, pri-misa 14 

T. Providing nutritious maab 
prkniB89 



vary auccaaaftil 10.0 
highpriority 305 



vary succaaalul 244 
Ngh priority 422 



2a7 262 1&8 162 vary unsuccessful 
34,6 14.1 07.7 0S.1 low priority 



23.3 213 04.7 24.4 very unsuccessful 
24.1 19^ 02.4 1Z0 tow priority 



U. Providing a drug education 
program 

V. Providing an AIDS education 
prorram 

au^miaa 12, pri-miss 10 

W. Providing a sax education 
program 

auc-miaa 16. pri-miss 9 



very successful 25.3 29.9 21.8 092 118 very unsuccessful 

hlgli priority 540 204 12.6 01.1 05.7 low priority 

vary successful 162 2aO 2Z5 183 22.5 very unsuccessful 

high priority 418 232 183 017 06.1 low priority 

very successful 092 11.8 22.4 219 27.6 ver unsuccessful 

highpriority 318 205 19.3 1Q8 09£ tow priority 



X. Providing pregnancy counseling very successful 010 in.? 117 200 4Z7 very unsuccessful 
suc-mlaa 17, pri-misa 12 Ngh priority 317 iOX) 20.0 ^25 117 tow priority 



Y. Providing referrab to social 
service agencies 

suc-misa 174)ri-miss 13 

Z. Providing positive role models 
each cat-missing 9 



very successful 22.7 213 34.7 ;u7 10.7 very unsuccessful 
Ngh priority 416 216 203 01^ 023 tow priority 



very successful 21.7 323 31.3 09.6 043 very unsuccessful 
Ngh priority 412 313 113 06.0 012 tov*' priority 



a. Providing a safe, orderly 
environment 



ver>* successful 21.1 4O0 14.4 122 122 very unsuccessful 
Ngh priority 708 19.1 017 01.1 022 low priority 



b. Creating a caring environment very successful 217 322 219 073 04.4 vety unsuccessful 

Ngh priority 619 112 102 043 01.1 tow priority 



c. Showing concern for students* very successful 22.5 
personal needs Ngh priority 59.8 



317 32.6 017 043 very unsuccessful 
210 1 1 3 014 023 tow priority 



d. Sening Ngh expectations 
for students 



very successful 146 
Ngh-iority 543 



211 343 14.6 079 very unsuccessful 
214 11.4 014 023 low priority 



e. Involving parents in 
student learning 



very successful 019 
Ngh priority 511 



144 217 27.8 222 very unsuccessful 
22.1 05.8 018 Oil low priority 
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TabI* 12.10 

Ftenk Ordtr, MMftt aiKi Standard OMiattons of Ratlngt Givm by TMch^ 
How SuecaaaM Thair Schoola Hava Baan in Matting Varioua Studanti' NMda.What Priori 
Thair Schoola Should Plaea on Each Araa, and tha Diacrapancy Batwaan tha Two 



31 AraaaRatad 

Hi (1)10 Low (5) 



Suecaaa (S) 



Rani( X 



Priority (P) 



BMTk X 



[>i8crapancy (S-P) 



Ranit 



A. Taaching basic 
litaraeyaidUs 

B. Teaching writing 

C. Taaching matha- 
manes 



«14 2.80 1.03 

«17 2.82 1.05 
« 7 2.56 1.08 



D. Taaching scianca «18 2.85 1.10 



E. Taaching sociai 
studiaa 



«11 2.66 1.09 



F. Taaching computer «1 2.23*""1.13 
sldUs 

a Teaching thiniting «23 3.13 1.28 
sidUs 

H. Taaching bilingual #13 2.78** 1.35 
education 



i. Taaching special 
education 

J. Teaching muW- 
culturai education 

K. Taaching art arKl 

music 



«3 2.36 1.08 
«19 2.92 1.21 
«30 3.70- 1.24 



L. Teaching the gitted «21 3.08 1.35 
and talented 



M. Teaching nrwnil/ 
athiical values 

N. TeacNng social 
courtaaiea 



«26 3.41 1.37 
«27 3.48 1.27 



O. Promoting students' «15 2.81 1.14 
self esteem 

P. Providing ooeupa- «28 3.52 1.21 
tional counaeiing 



Q. Providing educa- 
tional counaeiing 



«24 3.16 1.25 



*2 1.42 .80 

t4 1.56 .96 

«1 1.39 .66 

t19 ^00 1.02 

«14 1.91 .98 

«16 1.93 .94 

«9 1.70 1.12 

«29 2.52"**' 1.44 

«9 1.70 .91 

«26 2.30 1.27 

»31 2.62" 1.37 

«25 2.19 1.20 

«22 2.10 1.25 

•20 2.01 1.17 

«7 1.69 .96 

«28 2.01" 1.17 

•23 2.11 1.15 



«4 1.39 1.31 

«6 1.25 1.54 

«8 1.20 1.28 

«18 .85 1.39 

«21 .77 1.28 

«31 .31— 122 

«3 1.40 1.82 

«30 .33 1.39 

«27 .64 1.19 

«28 .59' 1.46 

«12 1.13 1.83 

«19 .83 1.53 

«5 1.29 1.66 

«2 1.49 1.65 

all 1.14 1.48 

• 14 1.08* 1.62 

«16 1.03 1.52 
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Tabia 12.10 (cont) 



31 ATMS Ratad Succasa IS) Priority (P) DIacrapancy (S - P) 
Hi(1)toLow(5) 

Rank X a Rank X a Rank X a 



R. Making rooma/ #9 2.58" 1.27 #17 1.98 1.07 «?6 .64- 1.56 
conidofs sttrictlvo 

S. ProvWIng ganaral «20 3.03" 1.24 #21 2.06 1.14 #17 .99 1.57 
heafth education 

T. Providing nutritioua #16 2.81" 1.49 #24 2.18 1.34 #25 .67 1.62 
maaia 

U. Providing a drug #8 2.56 1.34 #11 1.78 1.09 #20 .78 1.45 
aducatkm program 

V. ProvMinganAIOS #22 3.11" 1.40 #18 1.95 1.17 #9 1.17 1.61 
aducatkNi program 

W. Provklingasax #29 3.52" 1.27 #27 2.30 1.35 #10 1.15 1.70 
aducatkin program 

X. Proviaing pregnancy #31 3.79" 1.32 #30 2.53 1.42 #7 1.24 1.72 
counaaling 

Y. Providing rrtiarrala to #10 2.65 1.25 #15 1.92 i.'>5 #22 .74 1.32 
sodal aganciaa 

Z. i^rovlding poaltiva #5 2.43 1.08 #12 1.81 .97 #29 .58 1.39 
roio modai 

a. Providing a safe. #6 2.54""1.29 #3 1.45 .85 #13 1.10" 1.43 
orderiy environment 

b. Crwrtlng a caring «2 2.31* 1.09 «5 1.57 .93 «23 74 1.26 
environmont 

c. Showing concern for «4 2.37 1.05 «6 1.66 .97 «24 .71 1,29 
studanta'personai needs 

d. Setting high expecta- «12 2.73 1.12 « 9 1.70 .96 «15 1.03 1.41 
lions for students 

e. involving parents in t25 3.40 1.23 t13 1.84* 1.26 »1 1.60 1.65 
student learning 

Mote.- Teachers responded to each aspect in pairs according to the following format 

very successful 1 2 3 4 5 very unsuccessful 

high priority 1 2 3 4 5 lav priority 

*Slgniflee significant differences among school means at p < .05 
**S ignWee atgniflcant dtffierencee among school means at p <.01 
****Signifles significant differences anxKig school means at p < .0001. 
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If disaepancy scores are indicative of the magnitude of need, then teachers feel 
that involving parents in student learning should receive foremost attention. Teachers 
made the same assessment in their response to items from another section of the 
questionnaire on what is important to them. Teaching social courtesies also stands 
out as an area requiring attention from the teachers* point of view, regardless of the 
school. On still another section of the questionnaire, teachers rated their students* 
prosocial k)ehaviors more positively and their antisocial t)ehaviors more negatively 
than the students did for themselves. But a review of teachers* examnies suggested 
that some of them were citing very minor niceties to illustrate positive behaviors, and 
fairly objectionable infractions to illustrate anitsocial behaviors. (See Appendix A. 4 for 
these examples.) 

The descrepancy score for teaching thinking skills (comparing what the 
teachers think how well schools are doing versus what the priorities should be) ranked 
third, just barely ahead of ttie discrepancy score for teaching basic literacy skills. The 
difference in these ranks is not significant. Teachers feel that both are areas of great 
need in their schools, and indeed, their judgements are corrokx>rated by much 
independent evidence. It is also important to note that the teaching of moral and 
ethical values drew an assessment of great importance to teachers. While it is an 
issue which ranks low in terms of how successful they are, the disaepancy between 
tile estimates of success and priority places it dose to the top as an area in need of the 
school's attention. 

Individual Differences Among Schools 

School differences in the teachers' estimates Oi success their schools have 
achieved in various areas, the priorities which should be assigned, and the 
discrepancy values are highlighted in Table 12.1 1 . Especially sblking is tiie numt>er of 
areas on which schools differ significantly in the rates of success reported by their 
teachers. It is also noteworthy that for ttie most part, tiiese teachers' judgements 
con-espond closely with other independent assessments afcx>ut their schools. 

Special Instructional Programs 

The first major difference which is reported in Table 12.11 separates School 4 
from the other three schools for its special emphasis on computers, somettiing which 
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TABLE 12.11 



Sumrwy of Slgn«I<*nt F Radoifrom Ont-Wty AndysM of Varlanca of Taacher Ratings of 
Thdr SchooTs Succms Versus Priorities in Meeting Students' Needs and Duncan 
Tests of the Significance of Mean Differences Annong Schools 



Aspect of School Program Success IS) Priority IP) Discrepancy IS-P) 
Rated High ID to Low 15) 





F X Differences 


F X 


Differences 


F X 


Differences 


F. Teaching computer 
skais 


9.20**~Sch 4<2.3.1 


NS 




7.34"" 


Sch 4<3.2.1 


h. Teaching bilingual 
education 


4.46" Sch1.2<3.4 


8.68"' 


"Sch1.2<3.4 


NS 




J. Teaching multicuiturai 
education 


NS 


NS 




3.36" 


Sch 2.4<1.3 


K. Teaching art and 

music 


4.61" Sch2.3<1.4 


3.63" 


Sch 3<4 


NS 




P. Providing occupa- 
tional counseling 


NS 


2.92" 


Sch 1.3<4 


2.92" 


Sch 4<3.1 


R. Making rooma/ 
conldors attractlva 


4.27" Sch2.4<3 


NS 




4.85" 


Sch 2.4<1.3 


S. Providing gerwrai 
health education 


5.01" Sch1.3.2<4 


NS 




NS 




T. Providirtg nutritious 
meals 


3.42" Sch 2<4.3 


NS 




NS 




V. ProvklinganAIDS 
sducatkMi^ "ogram 


3.35" Sch3.1<4 


NS 




NS 




W. Providing k dex 
educatton program 


4.16" Sch3.1<4.2 


NS 




NS 




X Providing pregnarxy 
counseling 


2.85" Sch 1.3<2 


NS 




NS 




a. Providing a safe, 
orderiy environment 


10.55"" Sch 2.4<1<3 


NS 




3.84" 


Sch 2.4<1.3 


b. Creating a caring 
environment 


3.3r Sch2.4<3 


NS 




NS 




e. involving parents in 
student learning 


NS 


2.89" 


Sch 2.K3 


NS 





•p<.06 
**p<.01 



Note.-Lower means indicate higher levels of success and priority and smaller discrepancies. 
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is readily confirmed on inspection of the school sites. Interestingly teachers in School 
4 felt that their school's success in this area exceeded what the priority should be. The 
second significant difference was found in the area of bilingual education, for which 
teachers in Schools 1 and 2 reported greater success and also placed greater priority 
than teachers in Schools 3 and 4, not surprisingly because the former schools had 
bilingual programs serving students who were not fluent in English, where as the latter 
two schools did not. 

Physical Appearance of School Facilities 

Teachers in schools 2 and 4 rated their schools' success more highly on 
making common spaces in their school attractive than teachers in School 3; and the 
need to do something about this issue is suggested by the significantly higher 
discrepancy scores for teachers in both Schools 1 and 3. These differences did not 
correspond with the state of repair of the physical plants, except for School 2. which 
was judged to be the most advantaged physical facility. Schools 3 and 4 were the 
oldest and most decrepit facilities of the four, but despite its age (about 100 years old). 
School 4 reflected the efforts of its members to improve its appearance with extensive 
murals, paintings, banners, ete.. made by its students. There was some evidence of 
attempts to improve the cosmetic appearance of School 3 but the efforts were very 
uneven throughout the building. 

Attributes of the School Environment 

Envirorvnental sociologists would not be surprised to find that making schools 
and conidors attractive, as well as providing a safe, orderly environment were issues 
on which school differences reflected similar patterns, the former probably following 
the latter as a necessary precondition. A safe, orderly environment is a basic human 
need as well as a critical feature of successful schools which is well sut>stantiated by 
research. Teachers in the higher achieving schools. Schools 2 and 4. reported very 
significantly higher levels of success by their schools in providing safe, orderly 
environments than teachers reported for Schools 1 and 2; the contrast between the 
higher achieving schools and School 3 was especially noteworthy. 

School 1 is much larger than the others and serves a heterogeneous mix of 
racial and ethnic minorities, including a large group of black Hispanics in Its bilingual 
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program as well as substantial numbers of native bom black Americans. The noise 
and energy levels which explode upon change of classes by 700 early adolescents 
impress even the most casual observer of School 1. Size alone may account for the 
tenuous sense of safety and order reported by its teachers. Its student composition 
may be a contributing factor. An incident observed by the principal investigator 
illustrates this point. Just as the principal had given me an enthusiastic greeting, two 
students appeared in the reception area complaining in halting English atx)ut an 
episode with another student . The principal, herself an articulate, dedicated, and 
dynamic black woman of stately presence, began an animated conversation with the 
students, first in Spanish, then Haitian French. The matter was setUed quickly and the 
young black youths returned to their classrooms. The principal turned to ma laughing: 
"They were complaining about 'ttie American." That's what they call black students 
who were born here. ' The incident was not about race or dass. but about language 
arxJ culture. 

The teachors in School 3 rated ttieir school's success in providing a safe, 
orderly environment much lower than any of the other three schools. School 3 was a 
troubled school in a troubled area. The principalship of this predominantiy black 
neighboriiood school had changed hands ttiree times in six months. The exHfnarine 
who was in charge when the study was first engaged was reassigned in August. 1988, 
when a new. inexperienced, former vice principal was appointed to the post. A student 
of ttie effective schools literature, the second man set out to aeate a five-year plan for 
the school, ignoring the substantial efforts of the continuing vice-principal and a 
coalition of the faculty on another plan. He was dismissed in January. 1989, amidst 
growing staff turmoil; next, a woman was named in charge. She had apprenticed as 
vice principal under a principal considered to be one of the finest in the system, a 
person who saw fit to give hands-on field experience to his vice-principals in a school 
noted for its excellence. The newest principal had only four months to lead School 3 
when the data were collected from the teacher questionnaire. 

Not only were internal problems evident in School 3. tensions had inaeased in 
the surrounding neighborhood. The relative calm of Summer. 1988 gave way to 
episodes of gang violence in areas dose to the school. Some of the teachers daimed 
the school's dimate was worsened by the assignment of students from warring gangs 
to Uieir school. However, among this staff mari^ed by rapid turnover of more junior 
faculty members, senior teachers who lived in the neighborhood as well as the 
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assistant administrators who provided much needed stability, saw the situation 
differently. The tensions outside the school were unmistakat)le. txit inside the school 
gang related unrest was not the case, in their view. An incident reported previously in 
this report illustrates this view. A fight had occurred a few yards outside the school's 
front door; five tx>ys were t>eating up on a girl, all young adolescents, none of whom 
was a student at School 3. They had been walking home from early dismissal from a 
parochial school neart>y. 

Consistent with the findings just presented, teachers in Schools 2 and 4 feel 
their schools have been more successful in creatinn caring environments than 
teachers in School 3. School 1. which figured on the negative side of the significant 
differences in the schools' success in providing safe, orderly environments, was not 
significantly different from the other schools in creating an orderly environment. By 
many accounts arKi from other parts of the questionnaire data, it can be said that 
School 1 has an ethic of caring, bi •' Jze may detract from the order, if not the safety, 
of the environment. 

The item on providing nutritious meals is included in this section on attributes of 
the school environment because significant differences among schools correspond 
directly with whether or not the school has a cafeteria. School 2, v^ich teachers 
judged to k>e most successful in this regard, has a cafeteria; Schools 3 and 4 do not. 
(They have lunch rooms, but there are no cooking facilities.) School 1 has a cafeteria 
but its mean ranked in t)etween and was not significantly different from the others. 

Education and Counseling on Contemporary Issues and Prot)lems 

Several items were posed to teachers which dealt with students' need for 
education in areas which were not part of a school's traditional curriculum: genera* 
health, drug abuse, AIDS, sex education, and pregnancy counseling. The only one 
of these for which teacher estimates of success did not differ significantly among 
schools was success in providing a drug education program. This issue received a 
high rank both in terms of success (#8 from the top) and in terms of what its priority 
should be (#11 from the top out of 31 issues). Widespread, well founded fears on the 
influx of crack cocaine into the Boston area in Summer, 1988 was met with stepped up 
attention to drug education in the schools beginning in September, 1988. The priority 
has been sustained, and police have reported minor relief that use of crack did not 
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skyrocket as predicted, although gang violence has escalated to unprecedented 
levels. 

Significant differences among schools in teacher estimates of success were 
found for the items on meeting students' needs in other areas of health education and 
counseling. A dear pattern emerged. As shown in Table 12.1 1 , teachers in Schools 1 
and 3 unifdnmly rated their schools' success higher than teachers in one or both of the 
more academtoally oriented schools (Schools 2 and 4) on all of the following issues: 
providing general health education, AIDS education, sex education, and pregnancy 
counseling. Despite tine lesser success of Schools 2 and 4 in these areas, the 
teachers did not tiiink tiieir schools should assign greater priority to ttiese issues, as 
reflected in tiie lack of significant differences for discrepancy scores in the areas. The 
higher success rates in the nonacademic areas estimated by teachers for Schools 1 
and 3 are consistent witii what these teachers had to say in interviews and informal 
conversation-tiiat their students had basic needs which were not being met at home 
and had to be met by tiie schools first, if the teachers were to move on to more 
academic issues. 

The final item in tiiis set dealt with the schools' involving parents in student 
leaming. While success in this area was rated low (#25 out of 31 ), from the teachers' 
point of view, parental involvement ranked first in terms of the discrepancy between 
the school's success versus what priority it should receive. The schools were not 
significantiy different on these findings. However, there were significant differences in 
\he levels of priority which teachers felt tiieir schools should assign, to promoting 
parent involvement. As noted in Table 12.11, teachers in Schools 2 and 1 , tiie schools 
with bilingual programs, assigned higher priority to this issue than teachers in School 
3, tiie predominantly black neighborhood school. Teachers in School 3 already 
wori<ed closely with the parents when they could, but there wore many single working 
parents, and reportedly, absent parents. For the teachers in School 3, more parental 
involvement did not hold great promise for success with their students. 

Priorities for Teachers from the Students' Point of View 

A much shorter list of priorities for teachers from the students' p :int of view was 
included on page 15 of the Student Questionnaire (See Appendix B.I). Nine teacher 
behaviors were prefaced with the stem: ' It is important that teachers. ..." Factor analysis 
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TABLE 12.12 

Results of Factor Analysis of Students' Perceptions of What Teachers Should Do 



Factor Number Item weight Elgen- Pet of Cum 

&Name viiu« var P« 



1: Traditional Helping 3.44 38.2 38.2 

and Caring 

A. Halp m« do u wall as I can on tests. .59 

B. Teach me about right and wrong. .74 

C. Show me how to get along with .76 



E. Teach me how to read and write well. .67 

F. k/lake school a pleasant place to tM. .55 
I. Care at>out my future. .56 

2: Discuss Major Teen 1.36 15.1 53.3 

Prot)lems 



D. Discuss daig atxjse. -70 

G. Discuss teenage pregnancy. .85 

H. Discuss suicide. .86 



of Students' responses produced two significant factors which are presented in Table 
12.12. The first factor entitled Traditional Helping and Caring' behaviors drew six 
items loading .55 or higher. The second factor called "Discussing Major Teen 
Problems,' drew three very homogeneous items-that it is important for teachers to 
discuss: drug atxjse. teenage pregnancy, and suicide. All had very high weights, .70, 
.85 and .86 respectively. 

Traditional Helping and Caring Behaviors from Teachers 

A four-way analysis of variance of factor scores for Factor 1 produced dean, 
dear, ai i significant results. All main effects were significant; there were no 
significani interactions. These results are summarized in Tahle 12.13. The overall 
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TABLE 12.13 



Summary of Significant F Ratios from Four-Way Analyses of Varianca of Factor Scores 
On What Students Think Ideal Teachers Should Do. and Results of Duncan Tests 
Of the Significance of Mean Differences on Significant Main Effects: 
School. Grade. Se)^ and Race 



Significant Effects 


df 


F Duncan Tests of Mean Differences 


FACTOR 1: 


Traditional Caring. Helping Behaviors 


School 


3 


3.43* School 1 < School 2 


Grade 


2 


9.76"" Grades 8 < Grade 6 


Sex 


1 


7.22" Males < Females 


Race 


4 


3.95" Whites. Blacks < Asians 


No interactions 






FACTOR 2: Discussing Major Teen Prot}lems 


School 


3 


8.34"" School 2,4 < Schools 1,3 


Graide 


2 


NS 


Sex 


1 


40.54"" Males < Females 


Race 


4 


3.37" Others. Whites, Asians < Hispanics 


School X Grade 


6 


2.82" Very variat)le 



*p<.05 
"p < .01 
"p < .001 
•p < .0001 
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school difference significant at p < .05 was essentially a difference between students 
in School 1 versus School 2. An Interpretation based on salience seems most 
appropriate. Students and teachers in School 1 reported significantly higher 
frequencies of prosodal. caring behaviors than students and teachers in School 2 
(See Chapter 9.) As reported in Chapter 6. students in School 2 were more likely to 
say that their teachers promoted competition for test scores and independent learning 
as opposed to cooperative learning. 

Grade diffPiences and sex differences in the importance students assigned to 
traditional caring, helping behaviors by teachers were ►>ighly significant at p < .0001, 
and p < .01 respectively. Not surprisingly, students in grade 8 scored significantly 
lower on this factor than students in grade 6. and males reported significantly less 
caring on their part for caring, helping behaviors on the part of teachers. 

Differences in racial ethnic groups on Factor 1 were sigri .cant at p < .01. White 
and black students reported significantly less value than Asians for traditional caring 
and helping behaviors offered to them by their teachers. Many explanations are 
possible; one is most consistent vtnth data from the present study. As noted in Chapter 
7. those students who have lesser value for the benefits of education for their future, 
are more often white and black students in the sample schools. More than Hispanics 
or Asians, whites and blacks attending these inner city schools don't value education 
for future jobs. And. as shown in Table 12.13. the don't care as much as Asian about 
traditional helping caring behavior demonstrated to them by teachers. 

Teachers' Discussing Major Teen Problems 

Results of a four-way analysis of variance applied to students' factor scores for 
the importance of having teachers discuss major teen prolalems are reported in Table 
12.13. School differences were highly significant at p < .0001. The test of mean 
differences showed that students In Schools 2 and 4 felt it was significantly less 
Important than students in Schools 1 and 3 that their teachers discuss drug abuse, 
teen pregnancy, and suicide with them. This finding parallels closely the differences 
between teachers in the four schools, which were summarized earlier in Table 12.1 1. 
Teachers in School 1 and 3 recognized their students' needs in the areas of 
pregnancy counseling, sex education, and AIDS education, and tiiey reported their 
schools' greater success in these areas. Teachers in Schools 2 and 4. like their 
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students, do not feel that these areas are important responsibilities for ti^ j schools, it 
could be argued that the students and teachers in the schools are ^mply reinforcing 
each other's points o7 view on these issues, and do not reflect real need, but visits to 
the schools and conversations with schoc« personnel quickly dispel that argument. 

Tne main effect for :,;ade was not significant, although the intr i action effect for 
grade and school was significant at p < .01 . Inspection of the table of cell means for 
grades by sc^toois showed several small, variable fluctuations in no particular pattem. 
The fact that there was no statistically significant grade effect among sixth, seventh, 
and eighth graders is itself of practical significance. If students feel a need for their 
teachers' help in discussing the major problems, tha need is already established by 
sixth grade. 

The analysis of Factor 2 scores oroduced a highly significant sex differ^ince at p 
< .0001 . Females in all schools placed substantially more importance than males on 
their teachers' discussing major problems with them. Sir^e the factor included an 
item on teen pregnancy, as well as drug abuse and suicide, one might expect the 
females' scores to be higher, however, the sex difference may also reflect these 
females' greater willingness to ask for help. The significant difference by race/ethnicity 
placed Hispanics significantly higher thar whites and Asians in the importance they 
assign to teachers' disci>ssing major problems with them. The increasing rates of teen 
pregnancy among Hispanics, not just in these schools but nationally, may be reflected 
the students' response. But the difference may also parallel general cultural 
differences, with Hispanics more verbal and inclined to discuss issues with nonfamily 
members, and for young Asi^n students whose families prize academic achievement, 
these problems would be urtth*nkabie. 

Dtveloping Strategies and Setting Priorities for School Reform 

In thd opening pages of this chapter, it was noted that both the school reform 
movement and the teaching profession are at a crossroads. The path of teacher 
empowerment in the reform of schools will require that schools become more 
participatory, collegial ytjork environments for teachers, enabling them to behave as 
true professionais. If participatory, school-based management is to succeed as a 
strategy for implementing reforms, then a decision-making structure must be 
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developed in which teachers identify problems, identify the resources needed to solve 
them, and work collaboratively toward their solution. 

The most successful of the four schools in this study had been using a cluster 
system for many years, not unlike those used in many successful suburban middle 
schools, in which teachers worked together with the same group of students in all 
subjctct areas. Some teachers would ha**e particular responsibility for certain subjects, 
but rigid teaching assignments t>y discipline were not used. The arrangement enabled 
the teachers to get to know their students well, and to shape the curriculum prescribed 
from "downtown" in ways that were responsive to their students* needs and abilities. 
("Downtown* is the euphemism teachers use to identify the system's bureaucratic 
central adminisb-ation.) The teachers in School 4 reported through their leader to the 
principal, who seived as the decision maker with regard to the acquisition and 
allocation of resources. 

Indicators for Deciding Which Issues to Address 

Once an organizational structure is in place which will permit teacher 
participation in decision making, a sti^ategic question must be addressed about which 
dedsions teachers will bw involved in making. Sections of the teacher questionnaire 
which were reported on in this chapter can be very useful to this end. The items in 
Section 14 can be used to determine those areas in which teachers feel they do have 
irifluence. Reconstixicted as two-part items ("How much say do you have/should you 
have...), like those in Sections 17 and 18, the items can also be used to determine the 
broad areas in which teachers feel they ought to have a larger share in decision 
making. The items in Section 17 can provide another means for assessing what is 
most important to teachers in relation to their work. Then the specific content of the 
issues might be set according to tiie teachers' responses to questions about areas of 
success and priority fcr their schools, modeled after the items shown in Section 18. 

The analysis of the data need be no more sophisticated than calculating means 
'or each item and establishing their rank order. The ranks should not be used to mask 
what can be sligh. differences between adjacent means; ratiier, the exta'eme ranks are 
most telling about the school's high points and sore spots. If a much larger sample of 
teachers is surveyed, say in a large disbict, factqr analysis might be used on the longer 
sets of items to discover a smaller number of underiying dusters. Factor scores would 
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be calculated and their means determined by school. However, practitioners with 
whom we were able to discuss the results seemed to appreciate data which were 
directly linked to the actual questions their teachers answered. 

It is also important to note two dramatically different kinds of experiences which 
we encountered in reporting the results to practitioners in the system. When we 
addressed teachers and principals with summaries of the student and teacher 
questionnaire results for their own schools they seemed fascinated with the results, 
studying them carefully, discussing them eamestly, pausing to contemplate, then 
going back for more. This was uniformly the case for group discussions with teachers 
and individual meetings with principals. However, when we presented some of the 
same data anonymously to Directors of Instruction for all middle schools in the system, 
identifying "he data only as a summary from four of the system's middle schools^ their 
response took other forms, from posturing ('Oh, well that wouldn't be true for the XYZ 
SchooD, to disinterest ('This has nothing to do with my school'), to mild interest ("I 
think it would be interesting to see how our school would respond'). 

The Concept of Discrepancy 

The concept of discrepancy was very useful for formatting complex items, and 
for promoting efficient response. It also proved to be useful for analyzing the results of 
these lengthy item sets, reporting their results to principals and teachers in a 
meaningful fashion, and using the results to ploii r?)forms. As applied in Section 17, 
the two-part format posed items which inquired aboui the importance teachers place 
on various aspects of their jobs and how satisfied they are with that aspect. 
Discn^pancy scores were computed by subtracting satisfaction scores from importance 
scores for each ieacher in order to provide a gauge on the saliency of the issues as 
targets for change. Important issues which were least satisfied received high 
discrepancy scores, as was the case for parental involvement. Important issues which 
provided high levels of satisfaction received low scores, as was the case for teacher 
student relationships. As shown in Table 1 1 .2, the mean;> by item for importance 
versus satisfaction versus their discrepancy are easily rank ordered. The format 
disentangles complex issues and aids the choice of targets for change. 

Similariy, the items in Section 18 were given in two parts. Teachers were asked 
to indicate for each of 31 areas first, how successful their school has been with regard 
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to meeting student needs, and second, what priority their school should place on that 
area. Discrepancy scores were calculated by subtracting teacher ratings for the 
priority they would assign to a given item from their estimate of the success which their 
school had achieved. The discrepancy secret are designed to indicate the salience or 
importance of each area of need. There were several examples of areas on which 
schools were significantiy different by teacher estimates of success, but it was also the 
case that leachers did not hold high priorities for some of those areas. Again the 
concept of discrepancy proved useful for choosing problems to wori< on in their own 
schools. 

It is recommended that the two-part format used in Sections 17 and 18 be 
applied to the items in Section 14. In retrospect, it would have been very useful to 
know the discrepancy between responses to: 'How much say do you have in 
detennining the following issues?', versus 'How much say should you have...? 

The Role of the Principal in All of This 

The key issue in the success of school-based management for school reform is 
not decentralization participation in decision making by the school s professional 
staff. Principals must share power with teachers. New forms of participation in 
decision making will require dnrification of the basic tasks of administrators and 
teachers in this context. Debunking the myth of the "Great Principal' vnho surfaced in 
the literature from the first wave of school reform (Puri<ey & Smith, 1983). may be 
espedally appropriate at this time. 

Rallis and Highsmith make a compelling case that 'the first realistic step in 
school improvement is to recognize that school management and instructional 
leadership are twc different tasks that cannot be performed well by a single indivkiual' 
(1986. p. 300). Principals must be managers first. They are responsible for the 
acquisition and allocation of a school's resources, and for establishing and reinforcing 
a climate that is conducive to learning, one that is free of disciplinary problems and 
embodies high expectations for student achievement. Some principals may be able to 
take on insb-uctional leadership as well, but most do not have the time or resources to 
do both. This is particulariy true in small schools, but even in larger schools with 
assistants who could assume some of the management functions, principals are not 
likely to have the content knowledge and pedagogical expertise to lead instructional 
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development. Moreover, degree programs for administrators cover policy making, 
personnel management, financo, school law, and organizational theory, nof subject 
matter content, teaching, curriculum, or philosophy of education. 

Schools would be best advised to look within their own teaching ranks for 
instructional leaders who have the requisite breadth and depth of content, 
pedagogical and curricular knowledge, mediated by practical experience and 
sensitivity to human needs. Experienced master teachers within the schools should 
be identified and given the responsibility and accountability for working with their 
colleagues in meaningful systems of professional decision making. But, as Rallis and 
Highsmith are quick to point out. even someone witii tiie necessary qualities and 
experience to be an instructional leader cannot be effective unless someone else is 
working full-time to manage the school. The leader can empower; the manager must 
enable' (Rallis & Highsmith. 1986. p. 303). 

The move to school-based participatory management might begin by 
differentiating management and leadership functions and determining who should 
assume those responsibilities. Again, the indicators developed through the present 
study can be useful to this end. but some disagreements should be expected. For 
example, administrators may think it is their prerogative to supervise teachers closely 
and assume sole authority for tiieir evaluation, while teachers may feel that tiieir peers 
should have a role in ttie evaluation process. Indeed, cun-ent research attests to this 
difference in point of view. 

In a national survey of principals conducted by tiie Center for Research on 
Elementary and Middle Schools. 99.7% of the public and private school principals at 
all levels-elementary, middle, junior, and high school, indicated oven/vhelmingly that 
one component of their jobs is most important: observation of teachers and feedback 
on their performance. Other leadership components of their jobs received high 
ratings by principals, but some management functions were deemed to be less 
important. Only 30% of the principals cited personnel management as being above 
average in importance; the figures were 35% for coping with disorder. 40% for parent- 
community relations, and 53% for instiuctional management (CREMS. 1986). 
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Middle school teachers who constituted the sample for the present study had a 
different point of view, as illustrated in their responses (shown as percentages) to the 
following question from the teacher questionnaire: 

25. >A/hat do you think the principal's job should b«7 Plaass rank order the following in tenns of their 
importance, '1' being most important, '5' being least important 

1. to discipline the students 

1:10.5 2:16.3 3:15.1 4:20.9 5:37.2 

2. to supervise the teachers (Missing responses - 7) 

1:09.4 2:10.6 3:25.9 4:31.8 5:22.4 

3. to lead curriculum and program planning (Missing responses - 7) 

1:21.2 2:32.9 3:25.9 4:11.8 5:08.2 

4. to oversee school operations and scheduling (Missing responses - 8) 

1: 58.3 2: 22.6 3: 10.7 4: 07.1 5: 01.2 

5. to provide resources to teachers (Missing responses - 15) 

1: Cd.l 2: 26.0 3: 26.0 4: 22.1 5: 16.9 

The teachers assigned their first and second place ranks overwhelming to the 
importance of the p>rincipars management function in overseeing school operations 
and scheduling (80.9%), and least of all to supervising the teachers (20.0%). If the 
item is scored t}y weighting the ranks which teachers gave to the importance of the job 
function, a first place rank lieiriy a '5,' a second place rank a '4,' and so on, then the 
points resulting from this computation for each option are distrik>uted as follows: 1.) 
242 points; 2.) 253 points; 3.) 347 points; 4.) 429 points, and 5.) 289 points. 
Overseeing school operations and scheduling received by far the highest score; 
l€ading curriculum and program planning was a distant second, and providing 
resources to teachers a distant third. Disciplining students and supervising teachers 
fell dose together at the bottom of the ratings. 
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In interviews, teachers had very strong statements to make about their 
principals. There appeared to be little equivocation about what their job should be 
and how they should engage it. Teachers liked principals who hold clear, high 
expectations; who practice strict, and consistent enforcement of discipline; who 
enforce a schedule which promotes attention to academics, and who limit 
intenruptions to classes; who provide adequate resources to teachers; and who give 
teachers some scy in decision making. All of our interviews noted a delicate balance 
between strong leadership and the sharing of power with teachers. 

The research has been noting for some time the importance of the principal's 
leadership but the research is less dear on how the principals accomplish these 
things. Several quotes and anecdotes are reported here to specify how leadership is 
portrayed. 

Ms. X is very supportive of the t)ilingual. She wanted the kids, fought for 
the new teachers she needed, arxi did all V)e extra work to resdiedule 
the teachers in the mkklle of the semester. 

Another teacher related an anecdote about one bilingual si dent who was 
extremely upset and concerned about a serious problem at home. That student 
choose to seek help from an assistant principal, a real compliment to that person, she 
felt. One teacher seeking a well disciplined school with firmer control, security and 
safety and, therefore, more opportunity to deal with curriculum issues transferred to 
one of our schools and liked the style of his new principal very much: 'Ms. Z is 
everywhere!' There's very little that gets by that woman ' Another teacher: Mr. X has 
a lot to do with the atmosphere. There's freedom, trust, and a respect for the people 
who work in the building. I don't know how he does it. There*s method to his 
madness. .As a specialist, I've worked in several buildings in the systems, so I've seen 
a few principals and how buildings are run. Here it's like I died and went to heaven." 

Cleariy not all roles and responsibilities for teachers and administrators will fall 
out naturally. Teachers in this Boston sample reported dramatically different views on 
wha^ ^he principal's role should be than principals reported for themselves in a 
national survey (CREMS, 1986). It should also be noted that principals were asked 
what were the most important aspects of their job, not how do they actually spend their 
time. In any case, negotiation will be needed among the professional staff if 
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participatory school-based management is to be tried honestly. It may be that the 
"Great Principal' is one who is willing to share power with teachers, to enable them, so 
that they can empower themselves. 

Summary and Discussion 

After several years of sustained attention to the need to improve our nation's 
schools, the school reform movement is at a aossroads. So too is the future of the 
teaching profession in America. Either legislated prescriptions intended to raise 
standards will continue to strip teachers of opportunities to exercise seasoned 
judgement and professional discretion, or teachers will be empowered to engage in 
instructional leadership in schools which provide collegial work environments and 
opportunities to share in decision making. 

The first wave of reform set out to raise standards, inaease accountability, and 
promote rigor. The second wave is more enlightened, marked by a different and 
exciting agenda: participatory school-based management; cooperative, collegial 
school environments for both students and staff; flexible use of time; high expectations 
alongside an ethic of caring; curricula that focus on students* understanding, not only 
of what, but also their understanding of why and how; as well as an emphasis on 
higher-order thinking and conrplex problem solving for all students. This demanding 
agenda requires that teachers assurie positions of instructional leadership in a work 
environment tiiat treats tiiem as professionals. Administrators cannot do it alone. 

Teachers as prcfessionals must t>e central to the new reform efforts. Staff 
development will be part of tiie solution, but it must be sustained and focus on intent 
and programs which have solid grounding in research. Exte.^ded training and 
followup in a small nurril^^r of programs of proven effectiveness must prevail over 
faddism, political pressures, and reigning ideologies. Otherwise we will see the 
pendulum swings of recurring reforms whiCi only tinker with the system but fail to 
change in fundamental ways the way schools operate. 

Participatory decision making through school based management is a strategy 
for refomi which can enable stnjctural changes to reach the student. Principals and 
teachers need to participate in dedsions to affect what teachers do in the classroom. 
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This conception of school-based management requires a structure for decision making 
in which teachers identify problems, propose tentative solutions, and identify the 
resources needed to try them out Team leaders, duster coordinators, department 
heads, and assistant principals might serve as the advocates and negotiators for their 
teams of teachers. Principals must make the decisions on the acquisition and 
allocation of resources, while serving as the school's advocate to upper echelons of 
the system. 

This participatory role for teachers in decision making the site level requires 
that administrators recognize teachers as professionals who are trained to cope with 
uncertainty (Backarach & Conley. 1986) and who make scores of nontrivial decisions 
in the space of a single lesson (Berliner. 1984). Administrators must view ' achers 
not as assembly line workers following fixed procedures, but as decision makers and 
problem solvers-true professionals who continuously refine and acapt their 
pedagogical knowledge to new situations and changing needs of students. 

There has been conskjerable debate over which kinds of decisions teachers 
want to influence. Some researchers have found it striking how much teachers lack 
interest in major policy decisions, like budget, curriculum, and new programs. 
Research indicates that teachers wan^ tie greatest influence over operational 
classroom decisions including what to ieach. how to ieach and what textbooks to use. 
It would seem that day-to-day decisions rather than strategic choices are most 
important, but salience may be a factor; teachers are usually more concemed about 
budgets when they do not g€»t the supplies they need. Reportedly, the decisions in 
v\/hiai teachers feel most deprived are those which affect the boundary between the 
classroom arxi the school, which constrain teachers' decision making. 

The debate over which decisions teachers want to make and ought to make 
may stem from different points of view on what constitutes their professional identity 
and expertise. Whatever the decisions which they are empowered to make, to do so 
effectively teachers need good information, not only from their own professional 
insights and considerable experience in their schools, but from research, including 
participatory research. It is time for school reforms which promote more professional 
work environments for teachers including greater participation in decision making 
and involvement in research which can be used to inform the issues for decision 
making. 
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The present study developed many indicators whf jh can be used to gauge 
school effectiveness, including product measures or outcomes. But rt is also importarit 
that educators examine carefully the inputs and the processes of schooling, in order to 
make informed decisions about which reforms to undertake and how to proceed. The 
study considered demographic characteristics of students and teadiers. what values 
students held, and what is important and satisfying to teachers might be considered 
indicators of infuAs. We also developed process indicators which might be used to 
guide restructuring, help participants establish priorities, and identify strategies for 
change. 

The items in Section 14 of the Teacher Questionnaire were developed to 
assess teachers' perceptions of how mu say they have in 25 areas of influence. The 
distributions of percentages of teache.s choosing ea^ option to each item show 
striking skewness; either teachers feel they have a lot of say over a given issue or 
almost none. Very few distributions reflect a middle range of influence. Not 
surprisingly, teachers say they have greatest control over their own teaching methods 
and somewhat lesser influence over what informal tests are given, what 
supplementary materials they use. and what student grades are assigned. Means 
indicating a moderate level of influence are reported for the items on what 
instructional objectives are set. what content they teach, and whether students are 
promoted. More than half of *he areas (14 out of 25) received mean ratings by 
teachers which were in excess of 4.0 on a five point scale, where a '5* meant no 
influence, indicating the teachers feel they have very little, if any. say at)OUt many 
areas related to their wori^. 

Section 18 on the Teacher Questionnaire was designed ^o assist school 
personnel in assessing their accomplishments and in setting priorities for meeting 
student needs. It was a long set of items given in two parts. Teachers were asked to 
indicate for each of 31 areas first, how successful their school has been with regard to 
meeting student needs, and second, what priority their school should place on that 
area. Teachers were instructed to leave the item blank if they had no opinion. 
Discrepancy scores were calculated by sut>tracting teacher ratings fok the priority they 
would assign to a given item from their estimate of the success which their school had 
achieved. The discrepancy scores were designed to indicate ^e salience or 
importance of each area of need. 

9.70 
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If discrepancy scores are indicative of the magnitude of need, then teachers feel 
that involving parents in student learning should receive foremost attention. Teachers 
made the same assev»sment in their response to items from another section of the 
questionnaire on what is important to them. Teaching social courtesies also stands 
out as an area requiring adention from the teachers' point of view, regardless of the 
school. Teaching thinking skills ranked third in terms of what the teachers think 
schools are doing well versus what the priorities shouM be, and just barely ahead of 
teaching bask: literacy skills. The difference in these ranks is not significant. Teachers 
feel that both are areas of great need in their schools, and indeed, their judgements 
are corroborated by much independent evkjence. It is also important to note tha^ che 
teaching of moral and ethical valutas drew an assessment of great importance to 
teachers. While it is at^ issue which ranks low in terms of how successful they are and 
also what the priority sho. id be for that area, the disaepancy between the estimates of 
success and priority plact^ it close to the top as an area in need of the school's 
attention. 

School differences in the teachers' estimates of the success their schools have 
achieved in various areas, the priorities which should be assigned, and the 
discrepancy values are highlighted. Espedally striking is the number of areas on 
which schools differ significantiy in the rates of success reported by their teachers. It is 
also noteworthy thsit, for the most part, these teachers' judgements con^espond closely 
with other independent assessments about their schools. Oftentimes the areas in 
which schools differed significantly in their rates of success did not reflect significantly 
different discrepancy scores, because teachers did not uniformly hold high priorities 
for those items. The concept of discrepancy proved to be useful for helping teachers 
choose profc)iems to work on in their own schools. 

Once an organizational structure is in place which will permit teacher 
participation in decision making, the sets of items from the teacher questionnaire can 
be used to address the strategic question about which decisions teachers will be 
involved in making. The broad areas in which teachers want to play larger roles in 
decision making can be determined first by the kinds of items in Section 14 (How 
much say do you hav^oyei the following issues,' versus 'How much say should you 
have...?'). The items in Section 17 can provide another means for assessing what is 
most important to teachers in relation to their wori<. Then the specific content of the 
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issues might be set according to the teachers* responses to questions about areas of 
success and priority for their schools, modeled after t^l8 items shown in Section 18. 
The analysis of the data need be no more sophisticated than calculating means for 
each item and establishing their rank order. The ranks should not be used to mask 
what can be slight differences between adjacent means; rather, the extreme ranks are 
most telling atx>ut the school's high points and sore spots. 

It is also important to note two dramatically different kinds of experiences which 
we encountered in repori:ing the results to practitioners in the system, ^hen we 
addressed teachers and principals with summaries of the student and teacher 
questionnaire results for their own schools they seemed fascinated with the results, 
studying them carefully, discussing them earnestly, pausing to contemplate, then 
going back for more. However, when we presented some of the same data 
anonymously to Directors of Instruction for all middle schools the system, identifying 
the data only as a summary from four of the system's middle schools, their response 
took other forms, from posturing, to mild interest, to disinterest. 

The key issue in the success of school-based management for school reform is 
not decentralization but participation in decision making by the schcd's profest;ional 
staff. Principals must share power with teachers. New forms of participation in 
decision making will require clarification of the basic tasks of administrators and 
teachers in this context. Debunking the myth of the 'Great Principal' who surfaced in 
the literature from the first wave of school refbnm may be especially appropriate at this 
time. 

Rallis and Highsmith make a compelling case that 'the first realistic step in 
school improvement is to recognize that school managemant and instructional 
leadership are two different tasks that cannot be perlonmed well by a single iridividual' 
(1986, p. 300). Principals must be managers first. They are responsible for the 
acquisition and allocation of a school's resources, and for establishing and reinfordng 
a climate that is conducive to learning, one that is free of disciplinary problems and 
embodies high expectations for student achievement. Some principals may be able to 
take on instructional leadership as well, but most do not have the time or resources to 
do both. 
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Schools would be best advised to look within their own teaching ranks for 
instructional leaders who have the requisite breadth and depth of content, 
pedagogical and curricular knowledge, mediated by practical experience and 
sensitivity to human needs. Experienced master teachers witNn the schools should 
be identified and given the responsibility and accountability working with their 
colleagues in meaningful systems of professional decision making. But. even those 
with the necessary qualities and experience to be an instructional leader cannot be 
effective unless someone else is working full-time to manage the school. It may be 
ttiat tile 'Great Principal' is one who is willing to share power with teachers, to enable 
them, so Uiat teachers can empower themselves, and minister to students more 
effectively. 
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CHAPTER 13 



SUMMARY. CONCLUSIONS. AND SIGNIFICANCE 



Impetus for th& Study 

The most widely used metric for assessing school effectiveness has t>een student 
scorei. on standardized tests of basic skills. But this practice fails to aedit schools for 
providing health and social services meeting basic human needs for a number of their 
students, and it provides litUe incentive for schools to go beyond basics. This research 
sought to define more broadly the desired outeomes of effective schooling and to 
examine the practices and conditions in the school environment which promote 
positive behaviors 

The importance of school climaie for school effectiveness cannot be 
underestimated, according to the findings of several major studies. The school climate 
communicates important messages for peer group norms, studenx interaction, and 
student -teacher interaction. There is also important research on how work norms 
among the faculty appear to be especially important determinants of school 
effectiveness. When teachers have a shared sense of coliegiality and collectively 
embrace the need for continuing improvement, they create more constructive and 
productive environments for teaching and learning. 

Inae::*singly, schools are being targeted as the center for the dissemination of a 
broad range of health and social services. This is particularly so for schools in 
disadvantaged urt)an areas. Here many students go to school to find an environment 
whk:h is safer, warmer, or more secure than home, where they can get a nutritious 
breakfast and lunch they would not otherwise have, and where they can interact with 
caring adults. Hospitals, courts, and other social agencies have targeted urban 
schools as the points to access children and youth in need of prevention and 
intervention programs, before it's too late. Schools are being charged with meeting 
basic human needs formerly served by the family, the church, and other institutions in 
society. Without these sen^ices, we may well have a society in chaos. 
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Strategies for Collaborative Research 



University/scliool collatxjration in the conduct of this research was envisioned 
from the start. The thrust was to develop valid, practical indicators which can capture 
information abo\A school climate which the research literature has demonstrated is 
relevant to student achievement. We sought results which could be used to inform 
educators arxj policy makers about school level practices which need to be instituted 
or changed to promote student achievement. The definition of student achievement 
was broadened to include not only performance on standardized tests of t>asic skills 
but also higher order thinking and problem solving, prosocial behavior and 
community service. 

Student and teacher questionnaires were developed in collaboration with 
educators in the schools. They were designed to yieW comprehensive portraits of 
school climate, including the peopl? and their attributes, the social system and its 
pattems of relationships and interactions, and the culture of the school, including the 
norms, values, and beliefs reflected in the behavior of its members. Teacher 
interviews and ot)servation were used to complement and cross-reference the data 
obtained from the previous sources. 

Teacher questionnaires were administered at a time when teachers were 
occupied with demands for system wide testing and other end of the year activities. 
Many teachers were wonied about lay-offs, and morale was low. in some schools 
more than others. Against these odds, the rate of return for teacher questionnaires 
was approximately 50%. The student questionnaire was administered earlier, in 
March. 1989. vwth outstanding cooperation from the teachers and administrators in the 
schools. The return rate equalled the attendance rate for the days of administration, 
80%. In fact, we had a larger response rate to the student questionnaire than the 
Boston Public School had for its grade and test files on the students in the sample. 

The usable number of cases for all student instruments and measures are listed 
below: 



Student Climate Survey 
MAT Reading 
MAT Mathematics 
CRT-Math 



1583 
1279 
1265 
1145 
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Test of Problem Solving 
Final Grade in Reading 
Final Grade in Math 



Final Grade in English 
Final Grade in Science 



Final Grade in Social Studies 



972 
1175 
1548 
1484 
1337 
1263 



The Schools and the Students They Serve 

The four middle schools in the sample were described using information 
collected about each school on each of the following aspects: the buildings and their 
neighborhoods; the resources; the principals; the students; the teachers; and the 
school activities, txsth curricular arxJ extracurricular. Data were gathered from city 
records, newspapers, interviews, and observations over th.'ee years. While the four 
middle schools in this sample are part of the same school system, teach the same 
grades, and draw from a similar pool of students and teachers, there were notable 
differences. 

The sample sites for the research were four middle schools located in one 
disti-ict of the Boston Public Schools which had been paired officially with Boston 
University for 15 years, as part of a court ordered desegregation plan. While the 
neighborhoods were diverse, the students who attended the schools were more 
homogeneous economically, if not ettinically and racially, than their neightx>rhoods. 
This was the case because oftentimes families with financial discretion did not send 
their children to the public schools. The pattern was especially true for parents of 
females, who , if tiiey had marginal financial discretion, would choose to send their 
sons, but not their daughters, to ttiese schools. One of the first and most startling 
findings about Vne four schools in ttie sample was the overall sex ratio: almost 55% to 
45%. males to females. 

The one relatively more aff! tent neightx)rhood which was the setting for 
Schools 2 arKj 4 in the sample included a preponderance of childless households, 
including elderly people and young professionsds. College and graduate students 
and unrelated people living together to sh?re expenses were attracted to these 
neighborhoods, and inflate ttie median household income. Middle school students 
were bussed to Schools 2 and 4 in larger numbers ttian to the other two schools. 
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which drew more heavily from their own neighborhoods. The neighborhood for 
School 3 would be considered the most disadvantaged. 

Figures reported in City of Boston's Neighborhood Profiles {^B88) show the 
following differences based on 1984 data: 

Neighborhood Median Household Unemployment Percent in 



Income Rate Poverty 

School! $16,950 11% 31% 

Schools 2 &4 $22,400 3% 17% 

School 3 $13,000 14% 31% 

Citywide $19,250 6% 21% 



The administration of student questionnaires in the four schools was extremely 
successful in achieving a retum rate which was equal to the attendance rate, or about 
85% of the schools' enrollments, thanks in large measure to the high degree of 
cooperation offered by the teachers and administrators in the schools. Student data 
reported in the study was corroborated by data available from the Boston Public 
Schools. The figures on students presented here are those taken from self reports. 

Most of the students in the sample schools were minority group members. Of 
the major ethnic groups. Schools 2 and 4 presented a more balanced student 
population, while School 1 with its Hispanic bilingual program had a majority of 
Hispanics. while School 3 in a predominantly black neighborhood had an enrollment 
which was more than two-thirds black. Their racial/ethnic distributions were as follows: 



Race/Ethnidtv 




Black 


White 


Hisoanic 


Other 


School 1 


2.4% 


30.3% 


7.2% 


55.8% 


4.3% 


School 2 


24.4% 


26.7% 


10.8% 


33.2% 


5.8% 


School 3 


2.9% 


67.1% 


6.2% 


18.6% 


5.2% 


School 4 


26.8% 


36.0% 


12.6% 


18.6% 


6.0% 
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The vast majority of students at the four schools reported their ages to be 
between 12 and 14. in March of thai' school year. Only 12% were younger than 12 
years of age, and 10.5% were older than 14. School 4 was significantly different from 
the other three schools in enrolling a majority of girls. The sex ratios tai<en from 
student questionnaires in the four schools were as follows: 



Sex Ratio 


Male 


Female 


School 1 


53.1% 


46.9% 


School 2 


59.2% 


40.8% 


School 3 


56.6% 


43.3% 


School 4 


48.0% 


52.0% 



Building, Size, and Scheduling 

All of the school buildings were old, consequently needing constant and costly 
maintenance. School 3 and a part of School 4, having been built at the turn of th*) 
twentieth century, were tNrty years older than the other schools. The others. Schools 
1 and 2, and the annex to School 4, were built in the 1930's. School 1 housed the 
largest student population; almost two and a half times that of School 3, and 1.67 
times the size of Schools 2 and 4. 

Scheduling at School 1 differed from that of the other three schools. School 1 
had 5 periods plus homeroom and a silent reading period. The additional time 
needed for each period at School 1 may have been necessary simply for its very large 
student body to move from class to dass. The other three schools had six periods 
plus homeroom and silent reading periods. They scheduled 45- minute classes, 
creating an additional period from the saved minutes. 

Scheduling at School 4 was very precise. A teacher said, 'Classes start five 
minutes before the official time. The filing rule means all students and all teachers are 
in corridors as students file in single file along corridors to the next dass. Clocks, 
watches, etc. are synchronized.' 
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Principals 



During tlie past 10 >'ears, Schools 1 and 4 had experienced the sustained 
leadership of one principal for 10 and 8 years respectively. The principal of School 4 
had resigned that position to assume an assistant superintendency. His successor 
was assigned in a smooth, orderiy fashion. School 2's principal was entering his 
third year in office there during the yerr of most data collection for the study; he was 
transferred in the final year of the study, and replaced by another man. But School 3 
had had a succession of three principals in the year and a half of data collection. 
Among all of the principals, the six men included one Asian, one white, two Hispanics 
and two blacks. Both women were black. All were very highly educated, with many 
credits beyond a master's degree but not a doctcrate. All were experienced educators 
with at least some formal, supervised training in administration and leadership. 

Teachers 

Percentages of teachers responding were: in School 1, 48%; School 2, 33% 
(and an additional 19% who responded to an eariier version of questionnaire); School 
3. 80%; and School 4, 58%. The teachers in the four schools were not significantly 
different from ej.ch other on a number of demographic characteristics. Their 
male/female ratio was 40.2% to 59.8%. Their racial/ethnic distribution was as follows: 
Asian, 1.2%; black, 16.5%; Caucasian, 63.5%; Hispanic, 10.3%; and other, 5.9%; the 
balance, 2.3% would not say. The teachers constituted a highly edjcated wori< force. 
All of them had a least a bachelor's degree; 27% reported having some graduate 
work; 19% had a master's degree and 43% had credits beyond a masters degree. 

The teachers represented a wealth of teaching experience. Only 15.4% had 
between 1 and 5 years of experience; 20% had 6 to 10 years; 15.4% had 11 to 15 
years; 27.5% had 16 to 20 years; 11% had 21-25 years, and 1 1% had more than 25 
years. The fact that the teachers did not differ significantly among schools in any of 
these demographic characteristics was not surprising, because there is a great deal of 
transferring among teachers from one school to another within the sysiem. Only 
School 4 differed significantly in this respect. It had the highest percentage of 
teachers at the school for more than 5 years, 70%. The percentage of teacher who 
had been at School 1 more than 5 years was 32%, School 2, 36%, and School 3, only 
19%. 
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School Differences in Student Achievement 



The Boston Public Schools had instituted a program of extensive testing of 
students with Metropolitan Achievement Test (MAT) subtests in reading and 
mathematics, s/stem-wide criterion referenced tests (CRTs) in four subject areas, as 
well as a writing sample. All of these measures were to have been used for analysis in 
the present study. However in the year of data collection for the study, 1989. the 
schools cut back on the quantity of testing, limiting test adminisb'ation to the use of the 
two MAT subtests and ttie CRT in mathematics only. Only some schools collected and 
scored a writing sample, whose grade was supposed to be incorporated into the final 
grade in English. A new measure of high order ttiinking call Test of Problem Solving, 
or TOPS was administered witii representative results from two of the four schools.. 

Since the criterion-referenced tests which were preferred for the present study 
as measures more closely aligned with the goals of instruction were no longer being 
used, we elected to examine teachers' final grades in academic subjects. Teacher 
grades are idiosyncratic, because teachers are krxiwn to use a variety of methods and 
aiteria for assessing student performance. Grade to grade or school to school 
comparisons are virtually meaningless indicators of school differences. But grades 
have some utility in correlational analyses with test data and students' reports of 
rewards and punishments by ttie school and by teachers. 

Several kinds of analyses were reported for the student achievement data. 
First, descriptive statistics and graphic representation of mean scores were presented 
for all four achievement test measures. Then two-way analyses of variance by school 
and by grade-were summarized. For all measures, school differences were highly 
significant, as were most grade differences, txjt so were the interaction effects for these 
two factors. School to school differences had to be qualified according to grade level. 

School 1 showed the same pattern of performance relative to ttie other schools 
on all measures of achievement. It ranked at or near the bottom, and its students' 
performance declined, but not sharply, over grade levels. School 2 had consistent 
profiles for comparisons on each achievement measure; in each case student 
performance dropped precipitously fi'om grade six to grade seven, then rose sharply in 
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grade eight. The probable reason for this pattern was that better students left School 2 
after grade six to aftend the more prestigious examination schools in the system, and 
that lower achieving students dropped out after grade seven. School 3 showed very 
variable patterns on different measures of achievement. School 4 students were 
consistently at or near the top on all achievement measures at all grade levels but one: 
reading scores for their sixth grade students were lower than those of School 2. 

Since tracking occurs in the schools through student assignment to special 
programs, it was decided that a fairer way to compare the schools was program t>y 
program. All four schools had students assigned to regular programs with no special 
intervention, and all four schools had special education programs. Only Schools 1 
and 2 had bilingual programs. School 1 for Hispanics, and Scfiool 2 for speakers of 
Asian languages. Also, Schools 1 and 2 were the on^ ones with advanced work 
classes. In analyses by programs where all four schools 2ould be compared. School 4 
was consistently among the highest for which singificant differences were found, and 
School 1 was consistently at the bottom or among the combination of schools 
anchoring the low end. The pattem of highs and lows for School 3 was erratic, but 
most often School 3 ranked among the lower act-iieving schools. Students in School 2 
performed higher than students in School 1 on every achievement variable in every 
analysis, overall, by grade, and by program. 

Correlations among achievement measures showed that regardless of sutiject, 
grades correlate with grades and test scores correlate with test scores, producing 
moderate to high correlation coefficients ranging from .52 to .76. Scores on the CRT 
and the MAT in mathematics correlated .76 and .61 respectively with final grades in 
mathematics. Intercorrelations between reading test scores and grades were not 
nearly as high, ranging from .17 to a maximum of .31 . The finding that test scores and 
final grades in reading correlate only .17 was alarming to nost observers who know 
the stress assigned to reading scores in the placement and promotion of students in 
the Boston Public School system. 

Students' reports of rewards and punishments accorded to them by the school 
and by teachers showed noteworthy correlations with test scores and with grades. 
Students who reported having been suspended or punished by teachers tended to 
have lower grades, but their test scores did not distinguish their achievement from 
those of students who reportud no suspensions or other punishments. Students who 
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reported being rewarded by the school or by teachers tended to have somewhat 
higher grades, but the correlation did not hold for test scores. Students who thought 
their teachers promoted competition among students actually did more p>oorly on 
tests. 

Finally, since funds could not be obtained to conduct a longitudinal study in the 
schools, it was decided to pull from the larger sample those eighth grade students who 
reported attending their present school since the sixth grade. This strategy enabi.d 
investigation of the schools' influence on student achievement over time. Results from 
these analyses confirmed those reported earlier. School differences in achievement 
showed the same pattems when the analyses were limited to eighth graders who had 
attended their schools for three years as they did for students overall. 

B>9yond Basics: Assessment of Higher Order Thinking 

Highly critical of the education being offered to students in middle grades in 
many of this country's schools, the Cameige Council on Adolescent Development 
charged that: 'Nowhere is this failure more evident than in the development of 
American young adolescents' critical reasoning and higher order thinking.' Under 
various labels, exhortations to teach for 'critical thinking,' 'higher order cognitive 
functioning,' and 'complex problem solving,' have been voiced for decades. What 
has changed dramatically is the way we gauge our sodety's productivity. No longer 
art we m an industrial age, but rather an age of information technology, in which many 
people need to make a living by thinking, and not by rote assembly. Educational goals 
and ot)jecti*'es previously reserved for the elite are now being held for the masses. 

Fueling this renewed interest in teaching for higher order thinking skills is 'the 
single most important message of modern research on the nature of thinking' 
(Resnick, 1987, p. 8) that the kinds of processes traditionally associated with higher 
order thinking are not limited to advanced levels of development. In fact the tenn 
'higher order' skills is fundamentally misleading, because it suggests that lower order 
skills need to come first in a very linear fashion. The growing body of research in 
cognitive science on the acquisition of thinking skills particularly in reading, but also 
mathematics, attests to this finding. Long years of drill on the 'basics' before thinking 
and problem solving are required can no longer be justified. 
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Yet. higher order thinking and critical reasoning have not been taught 
extensively, probat)ly because teachers are unprepared to teach them well. Pervasive 
use of standardized tests of basic skills as the primary vehkde for accountability no 
doubt contributes to the problem. Despite the reason, the outcome is well 
documented; schoolchildren in this country do learn large amounts of information, but 
they do less well on what are variously called the 'higher order skills' or the 
metacognitive skills-how to analyze, synthesize, and evaluate that information for their 
own use. 

Defining higher order cognitive functioning is the first problem which writers on 
the topic must address. Disciplinary perspectives often color their choice of terms; 
philosophers promote logical thinking and critical reasoning; developmental 
psychologists point to metacognition; educators advocate teaching study skills and 
real life problem solving; cognitive scientists focus on cognitive strategies and 
heuristics for problem solving. Resnick's definition of higher order skills provides a 
fine complement to so many other definitions which emphasize the component 
processes. Her comprehensive yet succinct dufinition calls attention to the attributes 
of the problem situa^on and the reactions of the thinker as well. 

Higher order thinking involves a duster of elatx)rative mental 
activities requiring nuanced judgement and analysis of complex 
situations according to multiple criteria. Higher order thir^ir^ is 
effortful and depends on self-regulation. The path of action or correct 
answers are not fully specified in advance. The tNriker's task is to 
construct meaning and impose structure on situations rather ^an to 
expect to find them already apparent {Resvidk, 1987, p. 44). 

If the definition of higher order thinking is problematic, the measurement of 
higher order thinking is even more so. All 50 states use nationally normed 
standardized tests-of basic skills, but these tests emphasize recall of declarative or 
procedural knowledge, not the level or quality of student's thinking. Two compelling 
reasons for testing thinking are first, to determine how effectively thinking is being 
taught, and second is to ensure that it is. Several states have mandated both the 
teaching and testing of higher-order cognitive skills in their schools, but the mandate 
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outstrips the availability of appropriate measuring devices if not knowledgeable 
practice as well. 

The present project undertook the challenge of developing an instrument to 
measure higher order thinking in the context of high interest, realistic problems 
requiring scientific reasoning. The effort began with an existing instrument, previously 
developed by the principal investigator with support from the National Science 
Foundation. The test was revised according to the recommendations made in the 
previous study (Shann. 1976); questions with pocr item statistics were dropped; new 
items were created, but the general fonmat context-dependent items centered around a 
realistic scenario was retained. In addition, the language was updated. Children's 
names and surnames were varied to reflect the predominantly black and Hispanic 
student enrollments in the sample schools of the present project. 

The new test was named TOPS, or Test of Problem Solving. It contained 31 
items on five scenarios: 'Pets in the Classroom;' 'Bike Transportation;" "The Window 
Sill Garden;' and 'A Busy Comer;' and 'A Classroom Temperature Chart." Both 
Spanish and Vietnamese translations of TOPS were obtained. The test was 
administered during students' science periods, usable returns were collected from 972 
students. 

Several technical aspects were studied to appraise the psychometric qualities of 
TOPS: item analysis, subtest analysis, reliability and validity. Item analysis included 
the determination of item difficulty and item discrimination levels, as well as item-total 
correlations using serial and point biserial methods. The difficulty levels represented 
a broad range, the easiest answered correctly by 91% of the students, and the most 
difficult answered con-ectly by only 23%. Discrimination indices ranged ft-om .17 to 
. 68. ; most were mod&rate or better, rangi ng from . 50 and up. Each of the five subtests 
showed moderate to moderately high internal consistency reliability coefficients as 
detenmined by Cronbach's alpha. The values ranging from .50 to .67 are considered 
quite good for 6- and 7-items subtests. Reliability for the total test as determined by 
Cronbach's alpha was .84. 

Validity for the TOPS was established primarily through content analysis. 
Several opportunities were used to gather critiques of TOPS from graduate students in 
science and mathematics, from middle and secondary school teachers of these arnj 
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other subjects, and from professors of education, psychology, and related disciplines. 
Construction validation was also addressed through the use of multiple regression 
analyses to study skill in prot>lem solving In relation to reading comprehension, 
mathematics concepts, mathematics achievement, and grade level. The resui'^ dearly 
endorse the importance of language and not just mathematical reasoning in higher 
order thinking. 



Teaching Behaviors Which Promote Higher Student Achievement 

The major thrust of the preserit study has beer to aeate and validate indicators 
which can be used to monitor the process of school reform and to gauge whether 
schools are t)ecoming more effective in various ways. In all of this, school level rather 
than classroom level variat)les have been more salient for studying how the norms 
and culture of the school influence the tjehavior of its participants, fionetheless. 
effective teaching is at the core of effective schooling. While the researchers could not 
engage the study of teaching through sustained, direct ot)sen^ation, the team decided 
to include items of the teacher questionnaire which requested self-reports of the 
frequency of use of a variety of instructional practices. Teachers responded on a scale 
of one to five, and their scores were transformed so that a 'one' indicated 'almost 
never.' and a 'five' reflected 'a lot.' 

Factor analysis of the responses to the 16 items, as reported by 92 teachers, 
produced five significant factors with exceptionally dear results and dean loading. 
The five dusters accounted for 66.0% of the variance in the (yiginal data, and the 
majority of items loaded on only one of the five factors with weights in excess of .70. 
Factor scores were aeated by adding those items which weighted .50 or higher on 
each factor. The five teaching patterns were named as follows: Use of (1) 
Laboratory/Demonstration: (2) Direct Teaching (lecture and discussion with the 
whole dass); (3) Field Trips/Class Projects; (4) Small Groups/Student Led; and (5) 
Workbooks/Individual Assignments. 

These factor scores were used as dependent variables in the analysis of 
variance of teaching patterns by school. Instead of examining differences among all 
four schools a priori, post hoc designs were used in which the teachers were grouped 
by school according to the results of Duncan tests of the significance of mean 
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differences in student achievement among schools, within grade level. Depending 
on where significant differences existed among groups of schools on the measures of 
student achievement, teachers of those sutsjects at each grade \B^e\ were sorted into 
the same groupings of schools for the analysis of variance of teaching factor scores. 

Factor 1, on the use of LatMratory/Demonstration techniques, emerged as a 
strong, dear first factor but teachers who used these techniques were in the minority 
The factor was not significant in the analysis of any school differences in teaching 
pattens. However, it is important to note that the physical facilities, material resources, 
and class schedules which the teachers in the sample had to work with precluded all 
txjt heroic efforts to use laboratory and demonstration methods in their teaching on 
any regular basis. 

The limited use of laboratory and demonsiration techniques by science and 
mathematics teachers should be cause for concern. Thie American Association for the 
Advancement of Scienca (1989) in its landmdri< report. Science for All Americans, 
urges teachers to employ well-tested practices for effective teaching of science, 
mathematics and technology, chief among them, engaging students in active inquiry 
and investigation. Teachers should foster varied opportunities for inter.'iewing, 
surveying, and observing behavior as well as using hand lenses, microscopes, 
thermometers, cameras, and other common instruments. In addition, the National 
Science Foundation has sponsored many stjcitis of student inquiry which show that 
giving students opportunities to design experiments arxj manipulate science materials 
fosters positive effects of both a cognitive and affective nature regarding science (e.g., 
Shann, 1977). 

The second factor, entitled 'Direct Teaching,' included items on 'teacher 
lecturing to the whole class,' and 'teacher leading discussion among whole class.' 
which were weighted .83 and .81 respectively. It is traditional, or conventional whole- 
group teaching done well. Practices associated with direct teaching include rapid 
presentation of new content in small steps, guided student practice with close 
monitoring by the teacher, and regular review with corrective feedback and 
instructional reinforcement. This factor differentiated the teachers of seventh grade 
students who were more successful than their courrterparts in other schools on three 
of the four test measures: MAT-Mathematics, CRT-Mathematics, and TOPS, whose 
items reflect both science and mathematics contexts. Direct teaching was also 



287 



associated with higher student TOPS scores at the sixth and eighth grade levels. 
Teachers of the higher achieving students reportedly used direct teaching practices 
more frequently than teachers of lower achieving students. 

Factor 3 on the use of Field Trips/Class Projects differentiated between teachers 
of high versus lower achieving sixth grade students as determined by their scores on 
the MAT-Reading. Teachers of students in the higher scoring school reported more 
frequent of supervised trips and prqect-centered, whole dass activity. 

The fourth factor, entitled 'Student Led/Small Groups' represented a teaching 
pattern vA\\dt\ was associated with higher student achievement at both the sixth and 
the eighth grade levels on the MAT-Reading and at all three grade levels on TOPS. 
In addition it differentiated teachers of higher versus lower achieving eiglith graders on 
the MAT-Mathamaticj». Teachers who reported more frequent use of "Small 
Groups/Student Led' supposedly fostered activities in which students took 
responsibility for presentation and discussion of ideas among each other while the 
teacher visited the groups. This teaching pattern was associated with higher levels of 
student achievement in five of ten comparisons. 

The final factor which emerged from factor analysis of self-reported teaching 
behaviors was the use of 'Workbooks/Individual Assignments.' This factor was 
associated with differences in student achievement in four out of ten possible 
compaiisons. but in three out of four of these significant findings, students who had 
more dass time spent on wori<book and indivklual assignments had significantly lower 
scores than their counterparts wiiose teachers did not use this pattern so frequently. 
The one exception in which more frequent use of workbooks and individual 
assignments favored the highest achieving school was found for eighth graders from 
School 3 scoring highest on the CRT-Mathematics, whose teachers were knov^ to 
spend considerable time teaching for t .<( test with practice on examination items. 

Sixth grade and seventh grade students who performed less well on the MAT- 
Mathematics. and eighth grade students who scored significantly lower on the MAT- 
Reading all had teachers in tt-'>!>^ sut)iect ai- js who reported more frequent use of 
workbooks and individual assiyi.. jents than higher achieving students, whose 
teachers used significantly less of this pattern of teaching. Eighth grade students 
showed mixed results on the CRT-Mathematics in relation to their teachers reported 
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use of workbooks and individual assignments; it appeared that corresponding 
emphasis on direct teaching in conjunction with practice in worklxx>ks may have 
produced the superior results for classes at one school, but over reliance on 
workbooks without corresponding use of direct teaching was associated with the 
poorest performance on the CRT-Mathematics. 

If these striking res'jlts are indeed valid, teachers should be advised to limit 
students' use of workbooks and individual assignments during dass time. Instead 
they should use teaching patterns which promote higher student engagement, 
particulariy the kinds of activities suggested by Factor 4, which are reflected in 
cooperative leaming. Workbook exercises and individual assignments allow students 
to look like they are busy at work, when in fact they may not be. These assignments 
may be useful for some purposes as hon.ework assignments. Even then, students 
shouki receive written comments on what they do (Walberg, 1990). 

The analysis of teaching patterns associated with higher levels of student 
achievement was accomplished indirectly. After school differences in student 
performance on each of four achievement tests were otsserved to tie significant at 
every grade level, Duncan tests were used to spedfy which school means were 
different from other school means. Sorting teachers into the sam-? clusters of schools 
-jvhich differentiated students according to the achievement data, we conducted on 
analysis of their teaching patterns as measured by the factor scores of self-reported 
teaching practices. 

Methodological purists woukj caution that aggregation effects may account for 
any association between differences in student achievement and differences in 
teaching patterns, on the argument that higher achieving students and better qualified 
teachers would assemble at the same schools, more often those in advantaged 
suburbs than those in disadvantaged urban areas. While this may be a valid criticism 
of studt**^ which suggest causal links between higher student achievement anu higher 
teacher qualifrcations (Weaver, 1986), it is not a valid argument for the present study. 
Two-thirds of the teadiers reported earning advanced degrees, suggesting that there 
is little variatjility in their achievement levels, and all were teaching students who came 
from disadvantaged urban communities. However, if the use of actual teaching 
behaviors does correlate with student achievement, the finding has important 
implications for teacher training, staff development and classroom practice. 
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The inquiry about classroom teaching practices was secondary to the main 
thnjst of the study; the measures were self-reports, and the design was weak; it did not 
make strong connections between student achievement and actual classroom 
teaching practices of those students' teachers. Still, strong, dear factors emerged 
whteh distinguished teaching patterns u;,«d by more effective versus less effective 
teachers, as detemilned by student achievement. 

Given that Factor 1 included Laboratory/Demonstration activities whidi could 
not be used realistically In the schoob, differences in the remaining four teaching 
patterns were being compared, paralleling significant differences among schools on 
threo achievement tests, at each of three grade levels, making 36 possible differences. 
Since analysis with the fourth measure of student achievement (TOPS) produced no 
singificant schoolXgrade interaction effect, differences in the four teaching patterns 
were not qualified by grade. In all then, there were 40 possible differences (36 + 4) 
which might have been found In the analyses of teacNng behaviors, and 13 were 
found to be slgnlficarl at approximately the .05 level or beyond. Fully one-third were 
statistically significant, whereas only about 5%-fewv..- than three-would have have 
t)een significant by chance alone. 

These findings on teacher effectiveness suggest Important choices for staff 
development, scheduling, and coaching-all of which are school lt»vel, rattier than 
classroom level decisions, with Immediate Implications for strategies for school 
Improvement. 

The Students and What They Value 

if economically disadvantaged, largely minority youth who atterxj urt}an middle 
schools hold value systems like those reported by the vast majority of students In the 
present study, there Is reason to be optimistic atx3ut their futures. Teachers complain: 
•Just give me students vxho want to leami* If responsive, effective education can be 
made available to these students, it's not too late, because these studenti- want to be 
In school, ttiey want to learn, and they recognize ttie crudal importance of education to 
the quality of their lives in the future. 
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Very substantial percentages of the students use the highest point on the rating 
scale to indicate the importance ttiey place on family (92%). future education (83%). 
future job (83%). and getting good grades (79%). The basic human need of feeling 
safe is also deemed very important (68%). but ttie importance placed on friends, while 
still very substantial (42% choosing very important), is not as pronounced as the 
importance placed on family and education. The dlsbitxition of responses for the more 
hedonistic value of being rich flattens considerably; having fun and having a job now 
are also of relatively lesser importance. 

Tests of significance of differences in these values according to gender as well 
as race/ettinidty produce several significant differences. While the gender differences 
favoring ttie more positive outiook of females correspond with the stereotypes reported 
f:)r a sample of this socioeconomic level, the differences by race/ethnidty hold some 
surprises and do not conform to conventional stereotypes. Differences by grade are 
not significant, and differences by school correspond with ttie racial and gender 
differences which their disproportionate enrollments represent. 

Teachers recognize the importance of teaching values and serving as role 
models to tiieir students. While Uiese responsibilities are not actively high priorities for 
the teachers, tney report their schools (and by implication themselves) remiss in 
addressing this area of student needs satisfactorily. The disaepancy noted between 
success versus priority assigned to this area ranks fiftti among 31 areas rated by the 
teachers: teachers appear to be reporting ttiat they recognize the need to do more in 
schools atx)ut moral education of ttieir eariy adolescent students. 

The evidence indicates ttiat students hold very positive traditional value 
systems; they want teachers to 'teach us right from wrong'; and teachers concur with 
this need. The emergence of a very small minority in these schools whose values 
suggest they have no dream for the futui e but only the benefits of the present is 
disturbing. These youths who might be part of what has been termed an underclass, 
tend to be male, not female, and disproportionately white; to a lesser extent, 
disproportionate to ttie enrollments, they are black, but not Asian, and not Hispanic. 
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How Students Spend Their Time Outside of School 

The four urt>an middle schools in our sample are in session for students exactly 
six hours each d?.y. One with a delayed opening begins at 8:30 a.m. and ends at 2:30; 
the three others begin at 7:40 a.m. and send students home at 1 :40 p.m. According to 
schoo' personnel, many of these students go home to empty houses, where they 
watc:i TV and care for younger siblings who attend the elementary grades. Our data 
confimri the extent of televii^on watching. Fully 90% watch for at least an hour, almost 
70% watch TV for two hours or more. 30% for four hours or more after school. These 
viewing rates exceed what was reported nationally for high school seniors in the dass 
of 1985 (U.S. DOE-OERI. 1988. p. 109). Approximately 75% of high school mates and 
69% of the females in that graduating dass reported watching TV after school. It was 
their most common daily activity. 

The figures suggest that those who don't go home and watch television go out 
with friends after sdiod. or simply 'hang out.' Almost 70% of the sample reported 
going out with friends for an hour or more and a quarter (24.6%) spent 4 or more hours 
this way. 'Hanging out' occupied more than half (54.5%) the students for an hour or 
more each day. and for 20.8% it consumed four or more hours a day. 

Fully one-third spent no time reading after schod. but 44.2% daimed to read for 
one hour, few more than that. Half of the students reported spending an hour on 
homework after schod. another 26.3% spend two hours; 16.7% spend three hours or 
more, but only 6.7% claimed to do none. The low percentages of time spent reading 
probably reflects choice but also may refled lack of opportunity, the scarcity of •'lading 
material in the home. Three of the four schools reported that teachers are reluctant to 
send students home with text b< oks. There are not enough to go around, and the 
teachers fear the short supply will dwindle further. Instead, they prepare students with 
woricsheets or assignments in their notebooks. 

Students have very tew choices available to them. More than three quarters do 
not go to after schod programs, mostly because they are not available. Even fewer 
take lessons, for example in dandng, music, or language, because lessons are 
beyond the means of most of f lese families. Most of the children leave school by 1 :40 
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p.m.. and they have little else to do but watch television, see friends, and hang out. for 
four or more hours, urrtil their parents get home. 

Weei<ends present a similar picture of unstructured social activity with even 
more television viewing and considerably less homework. There are no Saturday 
programs at their schools for these students. Even playing sports occupies very little 
time for most of the students; 40% report no time during the week on sports and 41% 
spend no time playing sports on the weekend Slightly more than a quarter play sports 
on the weekend for three hours or more; considerably more students prefer to just 
hang out. Opportunities to play sports may be very limited; playing fields other than 
hardtop playgrounds in disrepair are not in evidence in the areas which these school 
serve. 

Playing sports preempts television, video games, and hanging out in temns of 
popularity as a summer activity. It may be that pools, rinks, and playing fields 
supervised by the Metropolitan District Commission in the areas where these students 
live are available during the summer, but not the school year. The data overall 
indicate that the student's choice on how to spend free time is very limited. 

Volunteer wori< is something that 26.5% of the total sample has tried. But the 
involvement drops off significantly as students advance to higher grade levels. Many 
educators and other concemed citizens point out that volunteer wort< is important as a 
socially desirable and influential activity in its own sake, quite apart from its possible 
influence on student achievement. If this is so. more opportunities ought to be made 
available to students to engage in such wortc. The pk:ture which emerges from the 
data overall is that students have few choices, and little structure to guide productive 
use of their time. 

Extending the school day. week, or year to include more of the same things 
which presently go on in schools with disappointing results is not the answer. But 
purposeful, structured activities with appropriate resources and adult supervision 
ought to be made available to these students. 

Schools and school systems wishing to survey their students on how they 
spend their time should consider using different response formats for some of the 
items. After school activities which are likely to occ»jr daily may be retained in the 
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same format as that shown in item 1 1 -doing chores, homework, watching TV. going 
out with friends, reading, playing sports, hanging out Babysitting should be added to 
the list, perhaps in two items-for younger brothers and sisters, and for another family. 
Certain after school activities may not occur daily, like working, going to an after school 
program, and taking lessons. These items should be separated from the others and 
their response fonmat changed to 'how many times each week'. ' for hew long.' 
Despite multiple pilot tests of the instrument, these points of confusion did not surface 
until the final administration of the instrument. 

Prosodal and Antisocial Behaviors in the Schools 

Students' prosodal and antisocial behaviors were used as an index of school 
climate. These behaviors shape the social system of the school and . jflect its culture, 
including its values and norms I'or permissible behavior. To assess these behaviors, 
parallel sets of items were used in the student and teacher questionnaires requesting 
their estimates of the frequency of prosocial and antisocial behaviors exhibited by 
students in their schools. These perceptual data were used as direct indicators of 
normative climate for each school. Observations during site visits by university-based 
members of the research team were used to corroborate the perceptual data from 
student and teacher groups. 

Students and teachers were generally consistent in their assessments of 
students' prosocial behaviors in the schools. Differences which occurred could be 
attributed to differences in the wording of the items, after changes were made in the 
student questionnaire to simplify the reading level. One difference between 
perceptions of students versus teachers occurred on identically worded items- 
students reported that they showed more respect for teachers than the teachers 
thought they did. Teachers were consistently more negative in their assessments of 
their students' antisocial behavior; students did not see themselves in such an 
unfavorable light. 

Results of previous studies about the consistency of perception of school 
climate among groups of respondents have been mixed. Some researchers have 
found that students, teachers, and administrators differ among themselves, but within 
one group are consistent (Ellet et al., 1977, Ellet & Walberg, 1979). Other researchers 
report that student and teacher measures are associated with more objective 
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measures of school ciimate. indicating that both groups perceive the school's climate 
In the sarr.9 way (Davis. 1963; Perkins. 1976). Results from the present study suggest 
that both findings may be valid; it depends on the target of the perception, and 
precisely how the perception is measured. Teachers and students were similar in their 
assessment of rrKJst prosodal behaviors. They were somewhat more discrepant in 
hav they rated antisocial behaviors: most likely, teachers were more sensitive to. 
more offended by. and/or more threatened by. their students' antisocial behaviors than 
the students were by their own peers' behavior. 

Previous studies on perception of dimate also suggest that variance may be a 
function of indivkJuaJ differences as well as organizational differences (Hoover. 1978; 
Moos. 1979). It Herr (1965) was correct, people will generalize from their own 
experience and environmental press, and differ in their perceptions according to sex. 
race. S£S. age. and grade. These are largely unalterable variables. The present 
study examined students' perceptions of behaviors with a four-way ANOVA design 
which enabled investigation of effects by sex. race, grade, but also school. These 
analyses produced a host of statistically significant results. 

Three gender differences were highly significant at p < .0001. One of these 
was significant even well beyond that level. By a substantial margin, females were far 
more likely than males to report that students in their schools engaged in behaviors 
which involved helping others directly. Also by a substantial margin they were more 
likely than males to report helping with tasks, probably because the females 
themselves engage more frequently in the helping behaviors. The females were also 
significantly more likely than males to report antisocial behaviors in their rrldst. 
arguably because these kiehaviors are more objectionable to the females. 

Four differences attributable to race/ethnicity were highly significant at p < 
.0001 . Three of these separated the Asians from all other radal/ethic groups. Asians 
were far less likely to report antisodal behaviors in their schools, including those 
which were dassified as relatively lesser infractions as well as those called major 
transgressions. It was suggested that Asians may be acculturated to ignore such 
violations, preferring to 'see no evil, hear no evil.' or they not be presen Nhen these 
negative behaviors take place. Several teachers and administrators in the schools 
have noted in conversation and in written remarks on questionnaires that the Asians 
oftentimes 'keep to themselves.' Asians were far more likely than all other 
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racial/ethnic groups to report showing respect, a finding which is consistent with this 
positive stereotype for Asian cultures. Another highly sigrificant difference by race 
separated the Hispanic and Asians from the others in their reports of helping others 
directly. Finally whites were less likely than Hispaniss to report helping with tasks. 

Grade differences were statistically significant in the analysis of all six factor 
scores. In every case, the sixth graders fell toward the more socially desiratsly 
position, reporting fewer antisocial behaviors and more prosocial t»ehaviors taking 
place than seventh and eighth graders. Again, if percept!'^ is a valid indicator of 
oisjective climate, and if climate conditions how people behave, then the sixth graders 
are behaving in more socially desirable ways than students in the next higher grades. 
The grade differences were especially significant for the prosocial behaviors, 
indicating that the younger students probably do have a more positive outlook and are 
more disposed to act in prosocial ways by helping others, helping with tasks, getting 
along, making friends, and showing respect. Here is where inten/entions need to be 
targeted-the sixth grade-in order to sustain these positive behaviors. 

Epstein, in personal conmunication. (1990) commented that these findings 
regarding grade differences are especially significant, because most previous studies 
which point to negative changes between "ixth and seventh grades compared 
students who were not in the same schools-sixth graders in K-6 or 4-6 configurations 
of grades, versus seventh graders in junior high schools or 7-12 schools. Even in 
longitudinal studies, there was concern that the school might account for the difference 
as much as the age. The present study conducted in middle schools which include 
grades 6. 7. and 8 suggests that differences can be attributable to both grade and 
school (as well as sex and race). 

Differences among schools were significant in the analysis of all of the prosocial 
and antisocial behavior factors except one. Highly significant differences in both 
lesser and more serious antisocial behaviors separated the academically higher 
achieving schools (Schools 2 and 4) from the two which were less successful 
academically. Students in the latter two schools (Schools 1 and 3) reported much 
higher frequencies of antisocial behaviors in their midst. But there was another 
significant ser)aration between schools on these variables as well, one which merits 
further attention. While the two high academic schools were significantly lower in 
antisocial behaviors than the other two schools, they were significantly different from 
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each ether as well. The school which ranked second on all achievement measures 
(School 2) when the more appropriate comparisons were made by program (bilingual, 
specal education, advanced, etc.) is the school which is lowest by far in antisocial 
behaviors. However, it is also lowest when it comes to the measure of friendship and 
racial/general harmony among students. To the outside observer, this school 
appeared to be run 'tike a marine drill camp,' pladng too high a priority on law and 
order. Its students were given few social freedoms in school-like no talking at lunch, 
single file changes of dass, segregated seating by sex in the cafeteria-and this policy 
may have taken its toll on the prosodal behaviors whid^ involve nurturing. 

Significant differences in prosodal twhaviors among schools consistently 
fnvored School 4. the top ranked academically. Its students' means for reported 
frequendes were always on the positive side of any significant differences. The other 
schods had mixed results. School 3, the smallest and probably poorest school in 
temns of its students' level of disadvantage, scored significantly lower than Schools 2. 
1. and 4 (ranked from low to high) in the students' perception of the frequencies of 
behaviors whk:h invdve helping others directly. This difference may reflect a serious 
deficit among the students in School 3 as much as objectively higher frequendes of 
helping behaviors in the other schools. 

Students in Schods 2 and 1 were significantly lower than students in Schod 4 
in their reports of getting along with each other and making fiiendships across radal 
and ethnic groups. Independent observations also suggested that School 4 was a 
friendlier, more harmonious place to be. It is especially noteworthy that this top 
ranked school academically appeared to strike a balance in achieving an orderly but 
also a friendly environment. On the final measure of prosodal behavior, showing 
respect, students in Schools 3 and 1 reported significantly lower frequendes of such 
behaviors than students in Schools 4 and 2. This highly significant difference favored 
the academically higher achieving schools over the lower achieving schools. 

The Value of School Climate Research 

While there is general agreement among researchers, reviewers, and 
practitioners as to Vne importance of school dimate for schod effediveness, there has 
been disagreement on whetiter it is worth studying. Critics have contested that school 
dimate is neither measurable (Rutter, et al., 1979; McPartiand I Epstein, 1975) nor 
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manipulable (Haller & Strike. 1979). Results from the foregoing analyses suggest 
othenvise. Indicators of prosoctal and antisocial student behaviors which were used 
in the present study produced results which were consistent, readily interpretable, and 
cross validated by conversations and formal interviews with participant reviewers and 
by independent observations. Most importantly, the indicators revealed important and 
meaningful differences among schools, as well as genders, racial/ethnic groups and 
grade levels. 

The failure of earlier studies to find significant school effects may have been the 
result of inadequate measurement, too few variables, or the wrong variables. Best 
known of these earlier studies, the Coleman Report (Coleman et al., 1966) inquired 
about who (persons and their attributes like SES and race) and what (classrooms, 
common room, special function fadlities. books, etc.) were in the building, rather than 
how participants used resources or how they related to one another. In Rutter's 
opinion (1980). these were grave omissions of previous studies which 'failed to take 
into account anything at)out the internal life of a school: its attitudes, values, mores or 
qualities as a social organization. It is just these social, rather than physical variables 
that do ac x)unt for much of the variation between schools. 

Critics of the value of school climate research considered it a burden to 
policymakers who woukj prefer to know how to manipulate school climate to effect 
positive outcomes. As Haller and Strike complained: 'It is undear. for example, who 
(much less how) an administrator or policy-maker might go about changing an 
organization's dimate' (1979. p. 236). While it was not an experimental study, the 
present study has yielded numerous schod differences on climate variables which 
suggest important implications for practice. 

It woukj appear from the present study of urban middls schools that high 
achieving schools must have orderiy environments unencumbered by antisocial 
behaviors. However this is not enough. To maximize potential, the schods should 
also have an ethic of caring, habits of helping ottiers. getting along and making 
friendships aaoss radal and etfinic groups. These prosodal behaviors distinguished 
between the first and second ranked schools, the top ranked schod appearing to have 
both the necessary and the suffident conditions. The lower achieving schools had 
neither. 
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Many schools do know how to maintain law and order, but as Firestone and his 
colleagues (1990) have observed, 'while order and high expectations are important, 
an expanded view of school effectiveness must be taken if we are to serve at-risk 
students welL***When a get tough orientation is overemphasized, safety is too often 
purchased at the price of personal freedom and self respect/ 

How Teachers and Principals Promote School Climate 

Teachers exert pervasive influence on students* behavior. Their realm of 
influence includes not only academic achievement, but also sodai nomis and values. 
The mechanisms by which they do this include setting expectations, providing models 
of behavior, and giving students feedback on what they do. The central task for 
schools and for students in particular is to engage students, so that they put forth 
serious effort and develop a commitment to mastering schoolwork. Social 
psychological dimensions of this task are not only instrumental to student learning but 
also important ends in their own right, such as showing respect for others, affiliating 
with others and sharing commitments. 

The social psychological dimension of schools appears to be particularly 
important for students at risk for school failure or dropout. Rather than viewing these 
students as ones with a disadvantage or deficit, it may be more constructive to note 
their higher sensitivity to positive school environments. Students at risk of school 
failure may be the very ones who stand to gain the most from the social capital which 
the schools need to provide, since families are no longer well equipped to do so. 
Such vulnerable students may be even more responsive to positive social and 
educational environments than students whose homes extend the a< nievement and 
value orientation of their schools. 

The importance of a safe, orderiy environment to a positive school climate has 
been recognized for some time; the influence of high expectations on student 
achievement has been known even longer. What is more recent, but perhaps just as 
important for students at risk, is careful documentation of the importance of a caring 
environment. An ethic of caring promotes respect affiliation and commitment among 
the adults and students in the school. These effects are mutually reinforcing for 
students and teachers: but if one side is low. it will depress the other. Factors 



299 



contributing to this cycle of commitment include not only respect and affiliation, but 
also relevance, administrative support for teachers, fair and consistent treatment of 
students according to clear rules, and having a sense of control over one's work. 
Several of these factors need to be orchestrated on a school-wide leve! by the 
prircipal. 

Indicators of teacher behaviors as well as the influence of teachers and 
principals on teachers and students were developed as part of the present study. 
Results of these measures were corroborated by interview and observation arxj shown 
to be related to the academic achievement rankings and prosodal behaviors in the 
schools. Teachers' commitment to students was attested in teachers' assignment of #1 
ranking to the importance of teacher/student relationships to job satisfaction, a finding 
which was overwhelmingly endorsed in interviews. Both students and their teachers 
in all four of the sample schools serving predominantly minority youth expressed 
shared responsibility for student achievement. The primacy of the academic mission 
of the school was recognized by students in both higher and lower achieving schools. 

What differentiated higher and lower achieving schools was an ethic of caring, a 
sense of cooperation among students, collegialrt^^ among teachers, and a mutual 
commitment between students and teachers. Principals were instrumental in making 
this possit)le, by exhibiting a strong sense of leadership in delicate balance with the 
sharing of power. Teachers felt support from each other and from principals; they had 
common planning time and a place for meetings. Students in schools whose teachers 
exhibited collegial behavior and affiliation toward others in the building were more 
likely to cooperate with each other. In turn, more cooperative rather than competitive 
teaching patterns, were associated with higher levels of studerrt achievement. 

Competition to do better than other students on tests and grades was negatively 
associated with achievement measures. Of particular note, this factor provided a dear 
separation between the two higher achieving schools. The school whose achievement 
was highest overall, and highest in comparisons within regular and special education 
programs-on every measure of achievement-had no advanced wori< classes, nor did 
it have the Asian bilingual program, both of which favored the second school. 
Moreover, the highest achieving school had a physical facility which was not neariy as 
pleasant and accommodating as the second ranked school. Both drew virtually the 
same size enrollments from very similar, adjacent communities. If anything, the 
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second school could be said to be more advantaged, yet it was significantly 
outperformed by the first. 

An ethic of caring made the difference. It permeated all of the data we 
collected-from students, teachers, and principals. The difference was not at all 
obvious at first; the schools felt different; the social interactions were different, but it 
was not until months after the study was engaged that a clearer picture emerged. 
When this qualitative picture was corroborated among several members of the 
research team who had visited the schools several times, the quantitative results of 
both student and teacher questionnaires ot.'.; -"onfinTied the results. The firxjings are 
significant noi only for what they say about facto . ^'ffecting student achievement, but 
especially because they are alterable variables amenable to chinge by helping 
principals to exercise effective leadership with ttie sharing of power, and by helping 
teachers to employ effective teaching practices with an ethic of caring. 

Some Very Important Qualities in Teachers 

While it is important to make the profession attractive to bright, talented, 
competent people, focusing efforts only on teacher preparation and licensure will be 
insufficient. The United States has ttie best educated teaching force it is likely to have 
for years to come, simply because a lot of teachers presently in the force had no real 
options when they made their career decisions. Now, equality of access to 
occupations means tiiat society can no longer ti-ap smart young blacks and women in 
teaching. The senior members of tiie teaching force will not be affected by changes in 
Itoensure, and they are still many years from retirement. Staff development will be 
crucial to promoting and sustaining teacher competence for both new and veteran 
teachers, but up-to-date knowledge of subject matter and pedagogy shoukj not be the 
only concerns. 

If academic excellence becomes the over-riding concern in teacher education, 
selection, and Iteensure. education may starxl to repeat the mistake of medteine in its 
single-minded pursuit of highly qualified applicants who test well and get good grades. 
By highly respected accounts, schools of m«!dicine had managed to select and train 
Vne compassion right out of its medical students, undoing the very quality we want to 
see in doctors who feat ourselves and our families. Since then, medical education 
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has developed many new programs to thwart the negative effects of severe 
competition for what can be more readily quantified-test scores and grades. 

Paradigms for research which have changed our thinking atxxjt how to study 
effective teaching and schooling call attention to what actions tiachers and others take 
to engage students and promote achievement, rather than what passive 
characteristics or credentials the teachers possess. But rather than t>eing 'passive 
traits." the value systems of teachers may be crucial for the central tasks of schools, 
although values alone are not sufficient. TNs hypothesis would be consistent with a 
major finding from the present study: what differentiates the performance of the 
highest achieving school from one which outwardly had more advantages was an 
ethic of caring. Both had high emphasis on acNevemnnt. but the more successful 
school was seen to be more collegial and cooperative by its teachers and by its 
students who also noted higher rates of prosodal behaviors in their mklst. 

Asked what they liked most about teaching in their schools, teachers named first 
and foremost their students. This finding was corroborate by results from the teacher 
questionnaire. One section contained 14 issues, presented in pairs, which inquired 
how important were various aspects of their job to job satisfaction, and how satisfied 
teachers were on these issues. Teachers felt that teacher/pupil relationships were 
most important, and reportedly they were more satisfied with this aspect than any 
other. Job security was the second most important concern, but among the least 
satisfied. Layoff notices have become a ni^ of spring which has taken on racial and 
ethnic overtones, since minority quotas continue to displace seniority as the basis for 
retention. Teacher performance is not considered in the iiismissal process. 

Teacher ratings of importance averaged toward the high end of the scale, 
between the highest and second highest score points for all but one of the 14 aspects 
of their jobs which were included on the questionnaire. The exception was the issue 
of teacher evaluation procedures, which teachers in School 4 rated significantly less 
important than teachers in the other three schools. Interviews with teachers and 
administrators in School 4 sug;jested a mindset among those teachers that they knew 
they were competent; if they weren't they wouldn't be there. The principal would 
somehow have managed to get rid of thein. 
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Average ratings for teacher satisfacjon with various aspects of their job were 
consist' ntly lower than they were for imporiarKe of those issues, txjt If the midpoint of 
the scale represents neutrality, then teachers on average reportedly were reasonat>ly 
satisfied about most aspects of their jobs. Significant differences among teachers in 
different schools were found for two aspects, teacher/teacher relationships and the 
school's cunicula. On coiiegial relationships, teachers in School 4 reported the more 
positive position than teachers in Schools 1 and 3; on the school's cunicula, the 
teachers in School 3 were significantly less satisfied thar teachers in the other three 
schools. 

Discrepancy scores were computed by subtracting satisfaction scores from 
importance scores for each teacher in order to provide a gauge on the saliency of the 
issues as targets for change. The discrepancy between job security and job 
satisfaction was second largest behind parentAeacher relationships. The discrepancy 
between the importance and satisfaction regarding the issue of salary ranked last out 
of fourteen Issues. Simply stated, the issue of salary was not an issue for these 
teachers in comparison to other, more pressing needs. Teachers reflected third and 
fourth highest levels of concern over the level of student achievement and their own 
participation in decision making. School principals may well be advised to act on the 
fourth-ranked concern by involving teachers in planning strategies for responding to 
the top three issues: parent/teacher relationships, job security, and student 
achievement. 



Empowering Teachers Without Loosing Sight of Students 

After several years of sustained attention to the need to improve our nation's 
schools, the school reform movement is at a aossroads. So too is the future of the 
teaching profession in America. Either legislated prescriptions intended to raise 
standards will continue to strip teachers of opportunities to exercise seasons^ 
judgement and professional discretion, or teachers will be empowered to engage in 
instructional leadership in schools which provide coiiegial work environments and 
opportunities to share in decision making. 

The first wave of reform set out to raise standards, inaease accountability, and 
promote rigor. The second wave is more enlightened, marked by a different and 
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exciting agenda: participatory school-based management; cooperative, collegia! 
school environments for both students and staff: flexible use of time: Ngh expectations 
alongside an ethic of caring; curricula that focus on students' understanding, not only 
of vtrhat. but also their understanding of why and how; as well as an emphasis on 
higher-order thinking and complex problem solving for all students. This demanding 
agenda requires that teachers assume positions of instructional leadership in a work 
environment that treats them as p>rofe«»onals. Administrators cannot do it alone. 

Teachers as professionals must be central to Vne new reform efforts. Staff 
development will be part of the solution, but it must be sustained and focus on content 
and programs which have solid grounding in research. Extended training and 
followup in a small number of programs of proven effectivenpss must prevail over 
faddism, political pressures, and reigning ideologies. Otherwise we will see the 
pendulum swings of recurring reforms which only tinker with the system but fail to 
change in furxlamental ways the way schools operate. 

Participatory decision making through school based management is a strategy 
for refomn whteh can enable structural changes to reach the student. Prindpais and 
leaders need to participate in decisions to affect what teaoWs do in ttie dassroom. 
This conception of school-based management requires a stnjcture for dedsion making 
in which teachers identify problems, propose tentative solutions, arMl identify the 
resources needed to try them out. Team leaders duster coordinators, department 
heads, and assistant prindpais might serve as the advocates and negotiators for their 
teams of teachers. Prindpais must make the decisions on the acquisition and 
allocation of resources, while serving as the school's advocate to upper echelons of 
the system. 

This partidpatory role for teachers in dedsion making at the site level requires 
that administrators recognize teachers as professionals who are trained to cope with 
uncertainty (Backarach & Conley. 1986) and who make scores of nontrivial dedsions 
in the ^ace of a single lesson (Berliner, 1984). Administrators must view teachers 
not as assembly line workers fdlowing fixed procedures, but as dedsion makers and 
problem solvers-true professionals who continuously refine and adapt their 
pedagogical knowledge to new situations arxJ changing needs of students. 
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There has been considerable debate over wNc!! kinds of decisions teachers 
teachers want to Influence. Some researchers have found it striking how much 
teachers lack interest in major policy decisions, like budget, cuniculum. and new 
programs. Research indicates that teachers want the greatest influence over 
operational classroom decisions including what to teach, how to teach and what 
textbooks to use. It would seem that day-to-day decisions rather than strategic choices 
are most important, but salience may be a factor; teachers are usually more 
concerned about budgets when they do not get the supplies they need. Reportedly 
the c easions in which teachers feel most deprived are those which affect the 
boundary between the classroom and the school, which constrain teachers' decision 
making. 

The debate over whk:h decisions teachers want to make and ought to make 
may stem from different points of view on what constitutes their professional identity 
and expertise. Whatever the decisions which they are empowered to make, to do so 
effectively teachers need good information, not only from their own professional 
insights and considerable experience in their schools, but from research, including 
participatory research. It is ^me for school reforms which promote mere professional 
work environments for teachers including greater participation in decision rr.aking 
and involvement in research which can be used to inform the issues for decision 
making. 

The present study developed many indicators which can be used to gauge 
school effectiveness, including product measures or outcomes. But it is also important 
that educators examine carefully the inputs arxl the processes of schooling, ir order to 
make informed decisions about which reforms to undertake and how to proceed. The 
study considered demographic characteristics of students and teachers, what values 
students hold, and what is important and satisfying to teachers, which might be 
considered indicators of inouts. We also developed process indicators which might be 
used to guide restruAuriiig. help partiupanis establish priorities, aiiu identify strategies 
for change. 

The items in Section 14 of the Teacher Questionnaire were developed to asses 
teache.'s' perceptions of how much say have in 25 areas of influence. The 
distritxjtions of percentages of teachers choosing each option to each item show 
striking skewness; either teachers feel they have a lot of say over a given issue or 
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almQSt none. Very few distributions reflect a middle range of influence. Not 
surprisingly, teachers say they have greatest control over their own teaching methods 
and somewhat lesser influence over what informal tests are given, what 
supplementary materials they use. and what student grades are assigned. Means 
Indicating a moderate level of influence are reported for the items on what 
Instructional objectives are set. what content they teach, and whether students are 
promoted. More than half of the areas (14 out of 25) received mean ratings by 
teachers which were in excess of 4.0 on a five point scale, where a '5' meant no 
influence, indicating the teachers feel they have very litUe if any say about many areas 
related to their work. 

Section 18 on the Teacher Questionnaire was designed to assist school 
personnel in assessing their accomplishments and in setting priorities for meeting 
student needs. It was a long set of items given in two parts. Teachers were asked to 
indicate for each of 31 areas first, how successful their school has been with regard to 
meeting student needs, and second, what priority their school should place on that 
area. Teachers were instructed to leave the item blank if they had no opinion. 
Oisaepancy scores were calculated by subtracting teacher ratings for the priority they 
would assign to a given item from their estimate of the success which their school had 
achieved. The discrepancy scores were designed to indicate the salience or 
importance of each area of need. 

If discrepancy scores are indicative of the magnitude of need, then teachers feel 
that involving parents in student learning should receive foremost attention. Teachers 
made the same assessment in their response to items from another section of the 
questionnaire on what is important to them. Teaching social courtesies also stands 
out as an area requiring attenti. n from the teachers' point of view, regardless of the 
school. Teaching thinking skills ranked third in terms of what the teachers think 
schools are doing well versus what the priorities should be. and just barely ahead of 
teaching basic literacy skills. The difference in these ranks is not signiffcant. Teachers 
feel that both are areas of great need in their schools, and Indeed, their judgements 
are corroborated by much independent evidence. It is also important to note that the 
teaching of moral and ethical values drew an assessment of great importance to 
teachers. While It is an issue which ranks low in terms of how si-ccessful they are and 
also what the priority should be for that area, the discrepancy between the estimates of 
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success and priority places it close to the top as an area in need of the school's 
attention. 



School differences in the teachers' estimates of success their schools have 
achieved in various areas, the priorities which should be assigned, and tt.e 
discrepancy values are highlighted. Especially striking is the number of areas on 
vvhich schools differ significantly in the rates of success reported by their teachers. It is 
also noteworthy that for the most part, these teachers' judgsrnents con-espond closely 
with other independent assessments about their schools. Oftentimes the areas in 
which schools differed significantly in their rates of success did not reflect significantly 
different discrepancy scores, because teachers did not uniformly hold high priorities 
for those items. The concept of disaepancy proved to be useful for helping teachers 
choose problems to wori< on in their own schools. 

Once an organizational structure is in place which will permit teacher 
participation in decision making, the sets of items from the teacher questionnaire can 
be used to address the strategic question about which dedsions teachers will be 
involved in making. The broad areas in which teachers want to play larger roles in 
decision making can be determined first by the items which inquire what say they do 
have over various areas versus what say they think they ought to have over those 
issues. Additional pairs of items can be used to assess what is most important to 
teachers in relation to their work versus what is most satisf>'ing. Those issues about 
which there is greatest discrepancy between importance and satsfaction might be 
targeted for special attention. Then the specific content of the issues might be set 
according to the teachers' responses to questions about areas of success and priority 
for their schools, modeled after the items shown in Section 18. The analysis of the 
data need be no more sophisticated than calculating means for each item and 
establishing their rank order. The ranks should not be used to mask what can be 
slight differences between adjacent means; rather, the extreme ranks are most telling 
about the school's high points and sore spots. 

It is also important to note two dramatically different kinds of experiences which 
we encountered in reporting the results *o practitioners in the system. When we 
addressed teachers and principals with summaries of the student and teacher 
questionnaire results foiJtl(fir own schools they seemed fascinated with the results, 
studying them carefully, di^ssing them eamestly, pausing to contemplate, then 
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going back for more. This was uniformly the case for group discussions with teachers 
and individual meetings with principals. However, when we presented some of the 
same data anonymously to Directors of Instruction for all rnddle schools in ti'ie system, 
identifying the data only as a summary from four of the system's middle schools, their 
response took other fomfis, from posturing ("Oh, well that wouldn't be true for the XYZ 
School'), to disinterest ("This has nothing to do with my school'), to mild interest ('I 
think it would be interesting to see how 3ur school would respond'). 

Participatory School Based Management 

The key issue in the success of school-based management for school refomfi is 
not decentralization but participation in decision making by the school's professional 
staff. Principals must share power with teachers. New forms of participation in 
decision making will require clarification of the basic tasks of administrators and 
teachers in this context. Debunking the myth of the 'Great Principal' who surfaced in 
the literature from the first wave of school reform may be especially appropriate at this 
time. 

Rallis and Highsmith make a compelling case that 'the first realistic step in 
school improvement is to recognize that school management and instructional 
leadership are two different tasks that cannot be performed well by a single individual' 
(1986, p. 300). Principals must be managers first. They are responsible for ihe 
acquisition and allocation of a school's resources, and for establishing and reinforcing 
a climate that is conducive to leaming, one that is free of disciplinary problems and 
embodies high expectations for student achievement. Some principals may be able to 
take on instructional leadership as well, but most do not have the time or resources to 
do both. 

Schools would be best advised to look within their own teaching ranks for 
instructional leaders who have the requisite breadth and depth of content, 
pedagogical and curricular knowledge, mediated by practical experience and 
sensitivity to human needs. Experienced master teachers within the schools should 
be identified and given the responsibility and accountability for worthing with their 
colleagues in meaningful systems of professional decision making. But, even those 
with the necessary qualities and experience to be an instructional leader cannot be 
effective unless someone else is woridng full-time to manage the school. It may be 
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that the 'Great Prindpal* is one who is willing to share power with teachers, to enable 
them, so that teachers can empower themselves and minister to students more 
effectively. 

Significance 

The middle school has bfien largely Ignored in the schooS effectiveness literature. 
On several counts, it can be said that here is the level of greatest need for inquiry on 
effective sdiool practices. The curriculum at this level nationally has been temned a 
'wasteland' by responsible educators. Moreover, it can be argued, here is where the 
trout)le begins. Academically, basic skills plateau or decline, as attested by recent 
reports of test scores released for the Boston Public Schools. Nationally. NAEP data 
mirror the same pattern, with declines in criterion - referenced performance measures 
beginning at the fourth -grade level. But the risks are pervasive: as Or. Oavid A. 
Hamburg noted in his recent address for the Carnegie Commission, early 
adolescence, the age of most middle schoolers, is an age of partiojlar vulneratjility. for 
drop out. pregnarK:y. drug and alcohol abuse, suicide, and delinquency. 

Schools can and do make a difference. Students at greatest risk for failure in life 
are those who drop out of school, who do not achieve basic functional literacy skills. 
Using appropriately designed studies and sensitive indicators of what schools actually 
try to do. evidence can be obtained to document the successes achieved in effective 
schools. The research can also be used to estat)lish the linkages between effective 
practices and the desired outcomes, and to guide efforts to make other schools more 
effective. It is this kind of evidence which can be most persuasive in seeking greater 
public and corporate support for school improvement. 
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APPENDIX A.1 

TEACHER QUESTIQNNAIRg 

RESEARCH FOR EFFECTIVE MIDDLE SCHOOLS PROJECT 

BOSTON UNIVERSITY SCHOOL OF EDUCATION 

This questionnaire is being used to gather information from teachers in middle schools about the 
responsibilities and conditions you face, and the resources and opportunities you have as professionals. 
Comotete confldentlalltv ly imft^, It is very Important that you be as candid as possible in your answers. 
Do not respond to any question that you feel is too personal or that for any other reason, you prefer to 
leave unanswered. We will report back to you the summary data for your school, but only group statistics 
will be reported. 

1. Are you male or female? 1. Male( ) Z Fennaie( ) 

2. What race/ethnic group do you belong to? 

I.Asian ( ) 

Z Blacic ( ) 

3. Caucasian ( ) 

4 Hispanic ( ) 

& Native American ( ) 

6. Other ( ); please specify 



3. How many years of experience as a teacher have you had? Include this year as one year of 
experience. years. 



4. How long have you been a teacher in this school? years 

5. What grade(s) are you teaching? Check all appropriate grades. 

1. 6thgrade( ) 
Z Tihgradel ) 
a 8thgrade( ) 

6. What is the highest degree you hokl? 

1. tjsss than a Bachelor's degree ( ) 
Z Bachelor's degree ( } 

3. Some graduate v^rk but less than a Master's degree ( ) 

4. Master's degree ( ) 

5. More than a Master's degree but not a Doctorate ( ) 
& Doctoral degree ( ) 



7. What was your major as an undergraduate? 
1. Education! ) 
Z UberalArlsl ) 

3. Education and a difcipllne area ( ): please specify discipline, 

4. Other ( ) : please specify 
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8. Wha^ WIS your major as a masters student? 

1. Notappiicable ( ) 

2. Education ( ): please indicate speciality 

3. Liberal Arts ( ): please specify discipline 

4. Education snd a discipline area ( ): please specify discipline 

5. Other ( ) : please specify 

9. What was your nuyor as a doctoral student? 

1. Notappiicable ( ) 

2. Education ( ): please indicate speciality 

3. Liberal Arts { ) : please specify discipline 

4. Education and a discipline area ( ): please specify discipline 

5. Other ( ): please specify 



10. What subject(s) do you teach? (Checic ail which apply.) 
1. Ijinguage Arts ( ) 
Z Mathematics ( ) 

3. Science ( ) 

4. Social Studies ( ) 

5. Physical Education ( ) 

6. Other; please specify . 



11. What language or languages do you teach in? (Check all which apply.) 
1. English ( ) 
Z SpMPiah ( ) 

3. Vietnamese ( ) 

4. French ( ) 

& HaitiarvCreole ( ) 

6. Other ( ); please specify 



12. Are you responsible for (participate in) any special programs in your school? (Checi< all that apply.) 
1. No ( ) 
Z BilinguaK ) 
a IjibSchod ( ) 

4. Special Education ( ) 

5. GifteJ^eneral ( ) 
& SpedalGifted ( ) 

7. Suppienrwntal/RenrMdial ( ) 

8. Other ( ); please specify 



13. In what other capacities do you serve students in the school, formally or informally, besides teaching? 
1. Athletic coaching ( ) 
Z Career counseling ( ) 

3. Academic counseling ( ) 

4. Personal counseling ( ) 

5. ClusterAeam leader ( ) 

6. Oepartnwnt head ( ) 

7. Nurse ( ) 
a Librarian ( ) 

9. Other ( ); please specify 

9. Other professional role: 
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14. How much smy do you hav« In determining the following Issues? 




Does not 




Moderate 








Alot 




None 


A. Your teacNng schedule 


0 


1 2 


3 4 


5 


B. Your room assignment 


0 


1 2 


3 4 


5 


C. Your cluster or teem assignment 


0 


1 2 


3 4 


5 


D. Your duster's (team's) leader 


0 


1 2 


3 4 


5 


E. What courses you teach 


0 


1 2 


3 4 


5 


F. Which ability levels you teach 


0 


1 2 


3 4 


S 


G. What content you teach 


0 


1 2 


3 4 


S 


H. What instructional objectives are set 


0 


1 2 


3 4 


5 


1. What teaching methods you use 


0 


2 


3 4 


5 


J. What textboolcs you use 


0 


1 2 


3 4 


5 


K. What other mattt.1zb you use 


0 


1 2 


3 4 


5 


L What standardized tests are given 


0 


1 2 


3 4 


5 


M. What informal tests are given 


0 


1 2 


3 4 


5 


N. What student grades are assigned 


0 


1 2 


3 4 


5 


0. Whether students are promoted 


0 


1 2 


3 4 


5 


P. How students are piaced 


0 


1 2 


3 4 


5 


Q. How teachers are evaluated 


0 


1 2 


3 4 


5 


R. Who evaluates you 


0 


1 2 


3 4 


5 


S. When your classes are observed 


0 


1 2 


3 4 


5 


T. What staff development takes place 


0 


1 2 


3 4 


5 


U. Which teachers serve on committees 


0 


1 2 


3 4 


5 


V. Which teachers attend conferences 


0 


1 2 


3 4 


5 


W. How inservice days are used 


0 


1 2 


3 4 


5 


X. How professional days are used 


0 


1 2 


3 4 


5 


Y. How school budgets are spent 


0 


1 2 


3 4 


5 
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15. Picas* circi* th« approprlat* number on tha S-point seala to Indlcata the extent to which 
teachers In your school exhibit the following behaviors: 



slot 



A. Engage in sodaJ conversation 

B. Excnange idef i about teaching 

C. Discuss problems about individual students 

D. Make negative remarks about other teachers 

E. Greet each other warmly 

F. Complain atwut working corniitiortt 

G. Joke about difficult situations 

H. Discuss personal problems with each other 

I. Share tabbing materials 

J. Discuss suggestions for new school programs 

K. Insult other teachers directiy 

K. Devekjpcuniculum materials together 

L. Work on test construction together 

M. Step in for other teachers in emergencies 



2 
2 
2 
2 
2 
2 
2 
2 
2 
2 

2 
2 
2 



sometimes 

3 
3 
3 
3 
3 
3 
3 
3 
3 
3 

3 
3 
3 



16. Ple«ise circle the appropriate number on the 5-point scale to indicat 
influence each of the following factors, individuals or groups have 
about the school's curriculum. 



alot 



A. Individual teachers 

B. Groups or clusters of teachers 

C. Principal 

D. Tradition 

E. District level administrators 

F. Central office administrators 

G. School committee 



2 
2 
2 
2 
2 
2 
2 



some 
3 
3 
3 
3 
3 
3 
3 



almost 

5 
5 
5 
5 
5 
5 
5 
5 
5 
5 

5 
5 
5 



the degree of 
er decisions 

Almost 
none 

5 

5 

5 

5 

5 

5 

5 
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17. PI««M circle thm approprittt« number on thm 5-point sci 
Importmnt Mch it«m is for your Job Mtisfactlon, and socon 
proMntiy with that aapoct of your Job. 



A. Salary: 



B. Job sacurtty 



C. Laval of student 
acWavament 



D. ParanVleachar 

rolationshlps 



Vary important 
Varysatisflad 

Vary Important 
Varysatisflad 

Vary Important 
Vary satisflad 



Vary Important 
Vary satisflad 



E. Taachar/laachar Vary important 
relationships Varysatisflad 



F. Taachar/pupil 
relationships 



Very important 
Very satisflad 



G. Taachar/admlnistra- Very important 
tor relationahipa Vary satisflad 



H. The curricula in 
school 



I. Teacher 
autonomy 



J. Teacher authority 
over students 



Very important 
Varysatisflad 



Very important 
Very satiifled 



Very important 
Very satisflad 



K. Teacher e\'aluation Very important 
procedures Very satisflad 



L Race jnltion for Very important 
teacher achievement Very satisflad 



M. Participation in 
maldng decisions 



Very important 
Very satisflad 



N. Administrative Very important 

support in improving Very satisflad 
student achievement 



2 
2 

2 
2 

2 
2 



2 
2 



2 
2 



2 
2 



2 
2 



2 
2 



2 
2 



2 
2 



2 
2 



2 
2 



2 
2 



2 
2 



3 
3 

3 
3 

3 
3 



3 
3 



3 
3 



3 
3 



3 
3 



3 
3 



3 
3 



3 
3 



3 
3 



3 
3 



3 
3 



3 
3 



le to indicate first how 
how well satisfied you are 



5 Very Unimportant 

5 Very unsatisfied 

5 Very (/nimportant 

Z Very ursatisfie 

5 very (//important 

5 very unsatisfied 



5 Very (/nimportant 
5 Very unsatisfied 



5 Very L/nimportant 
5 Very unsatisfied 



5 Very L/nimportant 
5 Very unsatisfied 



5 Very L/nimportant 
5 Very unsatisfied 



5 Very L/nimportant 
5 Very unsatisfied 



5 Very L/nimportant 
5 Very unsatisfied 



5 Very L/nimportant 
5 Very unsatisfied 



5 Very L/nimportant 
5 Very unsatisfied 



5 Very (/nimportant 
5 Very unsatisfied 



5 Very L/nimportant 
5 Very unsatisfied 



5 Very L/nimportant 
5 Very unsatisfied 
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18. PI«mM circle th« appropriate numbar on tha 5-polnt acala to Indlcata firat how auccaaaful 



you think thia achool haa baan wKh ragard to mmmtlna Mt udmnt naadi 



and aacond, what priority you think your achool ahould placa on that 
you hava no opinion, plaaaa laava tha itam blank. 



A. 


TaacMig basic IHaracy sWIla 


vary succeasful 1 


2 


3 < 


« 5 


very unsuccessful 




Ngh priority 1 


2 


3 


i 5 


taw priority 


B. 


Taaching writing 


vary succeasful 1 


2 


3 


4 5 


very unsuccessful 




Ngh priority 1 


2 


3 


i 5 


kvw priority 


C. 


TaacNng mathamatica 


'Vary succeasful 1 


2 


3 


4 5 


very u:isuccessful 




Ngh priority 1 


2 


3 


4 5 


kvw priority 


D. 


TaacNng scianca 


vary succeasful 1 


2 


3 


4 5 


very unsuccessful 




highpriority 1 


2 


3 


4 5 


low priority 


E. 


Taaching social studias 


vary successful 1 


2 


3 


4 5 


very unsuccessful 




Ngh priority 1 


2 


3 


4 5 


low priority 


F. 


Teaching computer sMIis 


vary successftJl 1 


2 


3 


4 5 


very unsuccessful 




Ngh priority 1 


2 


3 


4 5 


low priori 


G. 


Taaching thinldng sidlis 


vary succeasful 1 


2 


0% 

3 


4 0 


very unsuccessrui 




Ngh priority 1 


2 


3 


4 5 


low priority 


H. 


Teaching bilingual education 


vary succeasful 1 


2 


3 


4 5 


very unsuccessful 




high priority 1 


2 


3 


4 5 


low priority 


1. 


Teaching special education 


vary succeasful 1 


2 


3 


4 O 


very unsuccessrui 




Nghpriority 1 


2 


3 


4 5 


low priority 


J. 


Teaching multicultural education 


vary successful 1 


2 


3 


4 5 


very unsuccessful 




Ngh priority 1 


2 


3 


4 5 


low priority 


K. 


TaacNng art and music 


very successful 1 


2 


3 




wry unsuccossiui 




Nghpriority 1 


2 


3 


4 5 


low priority 


L. 


Teaching the gifted arnl talented 


very successful 1 


2 


3 


4 5 


very unsuccessful 




Nghpriority 1 


2 


3 


4 5 


low priority 


M. Teaching moral/athical valuas 


very successful 1 


2 


3 


4 5 


very unsuccessful 






Ngh priority 1 


2 


3 


4 5 


low priority 


N. 


TeacNng social couitesiea 


very successful 1 


2 


3 


4 5 


very unsuccessful 




Nghpriority 1 


2 


3 


4 5 


low priority 


0. 


Promoting students self esteem 


very succeasful 1 


2 


3 


4 5 


very unsuccessful 




Nghpriority 1 


2 


3 


4 5 


low priority 


P. 


Providing occupational 


vary successful 1 


2 


3 


4 5 


very unsuccessful 




counaeling 


Nghpriority 1 


2 


3 


4 5 


low priority 


Q. 


Providing educational 


vary succeasful 1 


2 


3 


4 5 


very unsuccessful 




counaeling 


Nghpriority 1 


2 


3 


4 S 


low priority 



In th« araas llstad balow. 
raa. If you dont know or If 
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18. (Cont) Again, pitas* circle tha approprlata numbar on tha S-poInt seaia to Indlcata first how 
auccaasful you think this school haa baan with ragara to mt studmnt nmmda In tha araas 
llstod balow, and aaeond. what priority you thinic your school should pisca on that araa. If you 
dont Imow or if you hava no opinion, piaaaa laave tha Itam bianiL 



R. MaMng rooira^conldors 
attracHva 



S. Providing ganaral hMlth 
adueation 



T. Providing r^utritious maais 



U. Providing a drug adueation 
program 

V. Providing an AIDS adu ition 
program 

W. Providing a sax adueation 
program 



vary suecasiAji 

high priority 



vary £.<eeaasltii 
irighprioi% 



vary aueeassfUl 
Ngh priority 



vary sueeaasfUl 

N{(r. priority 



vary sueeassftjl 

Ngli priority 



vary sueeassfUl 
high priority 



X Providing pragnaney eounsaling vary sueeassfUl 

Ngh priority 



Y. Providing rsflwnia to aoeiai 
SMviea agarclaa 



vary sueeassfjl 

highpriorfty 



Z. Providing positlva role medals vary sueeassfUl 

highpriorfty 



a Providing asafa. orderly 
environment 



vary aueeessiUI 
Ngh priority 



b. Creating a earing arrvironment very sueeessful 

Ngh priority 



e. Showing eoneem for students' very sueeessful 
personal needs Ngh priority 



d. Sotting Ngh expectations 
for students 

e. Irwolving pararrts in 
student learNng 



very sueeessfUl 
high priority 

very sueeessful 
Ngh priority 



2 
2 



2 
2 



2 
2 



2 
2 



2 
2 



2 
2 



2 
2 

2 
2 



2 
2 



2 
2 



2 
2 



2 
2 



2 
2 

2 
2 



3 
3 



3 
3 



3 
3 



3 
3 



3 
3 



3 
3 



3 
3 

3 
3 



3 
3 



3 
3 



3 
3 



3 
3 



3 
3 

3 
3 



S very unsueeasslUI 
5 lowpriortty 



5 very unsueeeasful 
5 lowpriority 



5 very unsueeessful 
5 lowpriority 



5 very unsueeessful 
5 lowpriOk-ity 



5 very unsueesssftil 
5 lowpriority 



5 very unsueeessful 
5 lowpriority 



5 very unsueeessful 

5 lowpriority 

5 very unsueeessful 

S towtfpriority 



5 very unsueeessful 
5 lowptiority 



5 verv unsueees^sful 
5 lowpriority 



5 very unsueeessful 
5 low pilority 



5 very unsueebc«ful 
5 lowpriority 



5 very unsueeessful 

5 lowpriority 

5 very unsueeessful 

5 lowpriority 
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Your answers are really important Please keep going. And thank you! 



19. Pl«as« cireU th« appropriate numbar on the 5-point scala to Indicate how often you use the 
following methods in your tr;aching: 

almost 

slot sonnetinfies twmr 


A. Teacher lecturing to the whole class 




2 


3 




i 5 


B. Teacher leading discussion anrK>ng whole class 




2 


3 




« 5 


C. Teacher visiting small groups within the class 




2 


3 




4 5 


D. Teacher giving danrK)nstration Nvlth equlppDent 




2 


3 




i 5 


E . Students giving presentations to the class 




2 


3 






F. Students discussing problents in small groups 




2 


3 






G. Students writing papers, stories, assignments 




2 


3 




4 S 


H. Studerrts filling in workbook? or exercise sheets 




2 


3 




4 5 


i. Students measuring, collecting data 


1 


2 


3 




4 5 


J. Students creating things 




2 


3 




4 5 


K. Students working In laboratories 




2 


3 




4 5 


L. Students taking supervisled field trips 




2 


3 




4 5 


M. Students working aJI on the same lesson 




2 


3 




4 5 


N. Students walking r bout the room 




2 


3 




4 5 


0. Whole class working together 




2 


3 




4 5 


P. Students working on a project of their choice 




2 


3 




4 5 


20. How important are each of the following factors in determining teach 
students? 


ing objectives for your 




very 
important 




important 




unmportBTt 


A. School policy 




2 


3 


4 


5 


B. Student Interest 




2 


3 


4 


5 


C. IndivMual student ability 




2 


3 


4 


5 


D. Your personal preference 




2 


3 


4 


5 


E. Available textbooks 




2 


3 


4 


5 


P. Other available resources 




2 


3 


4 


5 


G. What will be tested 




2 


3 


4 


5 
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21. Cirsl« thm appropriatt numbf»r on tha 5-point seala to indicala lha dagraa to which 
aaeh of tha following bahavlors ia typical of studanta in your school. Also, plaaaa giva a 
racdnl axampla of aach. 

navarhappana varytypicai 



A. Studant voluntaaring 
Exampia: 



B. Studant InvoNamant in dacision making 1 'I 3 4 5 

Exampia: 



C. Taking cara of school proparty 
txampia: 



D. Tolarating othars 
Exampia: 



E. Making friandshir^ across racial 
and athnlc groups 
Exampia: 



F. Showing raspact for taachars 
Exampia: 



G. Showing appradatton of taacnars 
Exampia: 



H. Showing intarast In iaaming 
Exampia: 



I. Halpingothar students iaarn 
Exampia: 



J. Participating in axIracurricuiaractMtias 
Exampia: 



1 2 



K. Compiimanting other students for 
goodwcvk 

Exampia: 
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22. Circiii thm mpproprimto luimbar on thm 5-point scmlo bolow to Indiemto tho degree to 
which each of the following behaviors Is typical of students in your school. Also, please 
give a recent example of each. 



no problem/ 
never happens 



vBrytypicsi 



A. Stealing 
Example:. 



B. Diistruction of school property 
Example: 



C. Sex offences 
Exsmple: 



D. Impertinence and discourtesy to 



Example: 



E. Meanness and bullying between students 1 
Example: 



F. Fighting 
Example: 



G.. Racial incidents 
Example: 



H. Tniancy 
Example: 
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no problem/ 
fMvar happens 



very typical 



I. Physical violence against teachers 
Example: 



J. Using profane or obscene language 
Example: 



K. Using Illegal dnjgs 
Example: 



L Drinking alcohol 
Example: 



M. Cheating on tests 
Example: 



N. Crsating classroom disorder or 
chaoa 



Example: 



0. Smoking in school 
Example: 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 
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23. What is your job? Plemsa rank order the following in terms of their importance, 'V being most important '5' being 
least important 

1. to help students learn 

2. to be a friend to students 

3. to teach values to students 

4. to take care of students (giving counseling, medical, social, or other services) 

5. other plaase specify , 

24. What do you think your job should be? Rease rank order the following in tenns of their importance, 'V being 
most importarrt '5' being least important 

1. to help students learn 

2. to be a friend to students 

3. to teach values to students 

4. to take care of students (giving counseling, medical, social, or other sen/ices) 

5. other plaase specify . 

25. What do you think the principal's job should be? Rease rank order the following in tenns of their importance, '1 ' 
being most important, '5' being least important 

1. to discipline the students 

2. to suponnse the teachers 

3. to lead curriculum and program planning 

4. the oversee school operations and scheduling 

5. to provide resources to teachers 



26. Please rank order what you like most about teaching in this school? 

1. the students 

2. the teachers 

3. the principal 

4. the physical environment 

5. other, please specify 



27. Rease rank order wtiat you would like to change in this school? 

1. student assignments 

2. the teaching staff 

3. the principal 

4. the physical environment 

5. other please specify 
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28. Do you partlcpcts in planning and decision making when you have the opportunity to do so? 



never elct 

1 2 3 4 5 

29. Do you partidpate in conrvnittees within your school besides cluster meetings? 

never elct 

1 2 3 4 5 

X. Do you participate in district or system wide committees? 

never eW 

1 2 3 4 5 



31. How are these opportunities comunicated to you? Please check all that apply. 

1. word of mouth (other teachers) ( ) 

z. smr meenngi \ } 

a kxjd speaker/Intercom ( ) 

4. noticee posted on a board ( ) 

5. mass mailngs to all teachers 

S. personal request or invitation by leader ( ) 
7. other ( ) 



32. Do you participate in any professional development activity outside of your work for the Boston Public 
Schools? 

Yes I ) No I ) 

If yes, please specify. 



33. Do you think this middle school has some special characteristics distinguishing it from other middle schools? 
Yes ( ) No ( ) 

b. If yes, wouki you please note briefly what you think those characteristics are? 



34. Please provkle any other comments which you think should be added to this questionnaire. 



You've finished! 



Thanl(saiot! 



You'H be hearing from us with the results. 
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APPENDIX A.2 

TEACHER QUESTIONNAiRg AFSPQNSgg- ALL SCHOOLS 

RESEARCH F OR EFFECTIVE MIDPLg SCHOOLS PROJECT 

BOSTON UNIVERSITY SCHOOL OF EDUCATION 

So that teachers would be as candid as possible in their answei^, they were advised not to respond to any 
questions that they feH were too personal or ^at, for any other reason, they preferred to leave 
unanswered. Complete confidentiality was assured. This report summarizes responses for all four 
schools. 

NOTE: Figures are valid %s. {Missing responses are emissing (only reported if > 6). 

1. AreyoumaJeorfsmale? 1. Male(402 ) Z Female(59.8 ) 

2. What race/ethnic group do you belong to? 

1. Asian {^2 ) 
Z Blade (1&5 ) 

3. Caucasian (63.5 ) 

4. Hispartc ( ia6 ) 

5. Native American {ZA ) 

6. Other (35 ); please specify 

Two people reported a combination - one was 3 & 4; the other was 3 & 5. Missing responses T 

3. How many years of experience as a teacher have you had? include this year as one year of experience. 

1-5years: 15.4 6- 10 years: 19.8 11 -15 years: 15.4 

1 6-20 years: 27.5 21-25 years: 1 1 .0 more than 25 years: 1 1 .0 

4. How long have you been a teacher in this school? 

1 year 20.0 2 years: 9.4 Syears 5i9 4 years: 9.4 5 years: 16.5 

6-10 years: 17.7 1 1-15 years: a4 more than 15 years: ia2 Missing responses-7. 

5. What grade(s) are you teaching? Checl( all appropriate grades. 

1 . 6th grade ( 20.0 ) 6th & 7th grades (8.2) All 3 grades (44.7) 

Z 7th grade (5.9 ) 6th & 8th grades (1^) Missing responses-7. 

a 8th grade (4.7 ) 7th & 8th grades (15.3) 

6. What is the highest degree you hold? 

1. Less thian a Bachelor's degree (0.0 ) 

2. Bachelor's degree (11.2 ) 

a Some graduate woric but less than a Master's degree (27.0 ) 

4. Master's degree (19.1 ) 

5. More than a Master^ degree but not a Doctorate (42.7 ) 
a Doctoral degree ( 0.00 ) 

7. What was your major as an undergraduate? 

1. Education (40.7 ) 
Z liberal Arts (20.9 ) 

a Education arnl a discipline area (22.0 ) : please specify discipline. 
4. Other (16.5 ): please specify . 
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8. What was your major as a rnasters student? 

1. Notapplcabia (14.1 ) 

2. Education (56.5 ): plaasa irulicato spadaJity. 

3. Ubaral Arts (5.9 ): plaasa specify discipline. 

4. Education wni a discipline area (17.6 ) : please specify discipline. 

5. Other (5.9 ) : please specify . 
Missing responses-?. 



9. What was your major as a doctoral student? 

1. Notapplcabie (9a4 ) 

2. Education (1.6 ): please indicate speciality. 

3. Uberal Arts (0.0 ): please specify discipline. 

4. Education and a discipline area (0.0 ): please specify discipline. 

5. Other (0.0 ) : please specify . 
Missing responses-31. 



10. What subjects) do you teach? (Check all which apply.) 

1. Language Arts (26^ ) 

2. Mathematics (22.3 ) 

3. Science (10.6 ) 

4. Social Studies (20.0 ) 

5. PhyslcaJ Education (1.8 ) 

6. Other (18.8); please specify. 
Missing responses-?. 



1 1. What language or languages do you teach in? (Check all which apply.) 

1. English (82.8 ) 

2. Spanish (15.2) 

3. Vietnamese (0.0) 

4. French (0.0) 

5. HaitiaivCreoie (0.0) 

6. Othr ( 2.0 ); please specify . 



12. Are you responsible for (participate in) any special programs in your school? (Check all that apply.) 

1. No (28.2) 

2. Bilingual ( 10.0) 

3. Lab School (5.5) 

4. Special Education (20.0) 

5. Gifted-general (3.6) 

6. Special Gifted (2.?) 

?. Supplenrmttal/Remedial (13.6) 
8. Other (16.4); please specify . 
Missing responses-8. 



13. In what other capacities do you serve students in the school, formally or informally, besides teaching? 

1. Athletk: coaching ( 8.9 ) 

2. Career counseling (10.9 ) 

3. Academic counseling (21.8 ) 

4. Personal counseling (29.? ) 

5. Cluster/team leader (9.9 ) 

6. Department head (4.0 ) 
?. Nurae (1.0 ) 

a Ubrarian (0.0 ) 

9. Other (13J ); please specify. 

9. Other professional role (0.0) 
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14. How much say do you hava In datarmining tha following Issuas? 



Doasnot 



Modarata 







•pply 


A ni 










A. 


YourtMching schsdule 


05.4 


08.7 


04.3 


12.0 


10.9 


58.7 


B. 


Your room assignmant 


08.7 


02.2 


04.3 


12.0 


06.5 


66.3 


C. 


Your dustar or team assignmant 


12.4 


10.1 


02.2 


12.4 


06.7 


56.2 


D. 


Yourdustar^ (taam's) laadar 


11.2 


09.0 


04.5 


06.7 


06.7 


61.8 


E. 


What coursaa you taach 


10.0 


16.7 


08.9 


14.4 


06.7 


43.3 


F. 


Which ability lavals you taach 


13.3 


05.6 


06.7 


12.2 


10.0 


52.2 


a 


What contant you taach 


10.2 


31.8 


14.8 


14.8 


04.5 


23.9 


H. 


What Instnjctkinal objactivas ara sat 


03.4 


37.1 


16.9 


18.0 


06.7 


.8.0 


1. 


What taaching methods you use 


04.4 


73.6 


14.3 


04.4 


01.1 


02.2 


J. 


What taxtt)oolcs you use 


05.6 


20.0 


07.8 


20.0 


17.8 


28.9 


K. 


What other materials you use 


02.2 


56.2 


18.0 


11.2 


05.6 


06.7 


L 


What standardized tests are given 


12.4 


04.5 


0.00 


06.7 


04.5 


71.9 


M. 


What informal tists are given 


04.6 


60.9 


17.2 


03.4 


02.3 


11.5 


N. 


What student grades are assigned 


03.4 


55.1 


13.5 


07.9 


04.5 


15.7 


0. 


Whether students ara promoted 


02.2 


13.2 


24.2 


25.3 


12.1 


23.1 


P. 


How studei;t5 :ire placed 


03.3 


11.0 


15.4 


29.7 


13.2 


27.5 


Q. 


How teachers are evaii:ated 


05.6 


02.2 


01.1 


00.0 


11.2 


79.8 


R. 


Who evaluates you 


03.3 


02.2 


01.1 


00.0 


07.7 


85.7 


S. 


Whan your ciasses ara observed 


06.7 


02.2 


04.4 


23.:- 


15.6 


47.8 


T. 


What staff development takes place 


05.7 


04.6 


05.7 


17.2 


21.8 


44.8 


U. 


Which teachers serve on committees 


06.7 


04.5 


07.9 


33.7 


15.-' 


31.5 


V. 


Which teachers attend conferences 


05.6 


01.1 


02.2 


21.3 


09.0 


60.7 


w. 


How Inservice days are used 


00.0 


02.2 


05.5 


15.4 


18.7 


58.2 


X. 


How profsssionai days ar' used 


01.1 


04.4 


05.5 


13.2 


09.9 


65.9 


Y. 


How school budgets are spent 


02.2 


01.1 


OM 


06.6 


05.5 


83.5 
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IS. Pl«as« circit Xhm appropriate numbar on tha 5-point acala to indicata tha axtant to 
which taachara in your achool axhibit tha following bahaviora: 







slot 




aoinatinnas 




aknost 
n&m 


A. 


Engage in social conversation 


32.6 


19.6 


39.1 


05.4 


03.3 


B. 


Exchange ideas about teaching 


18.5 


21.7 


38.0 


12.0 


09.8 


C. 


Discuss problems about individuai students 


40.2 


32.6 


20.7 


04.3 


02.2 


D. 


M»kb negative remarks about other teachers 


19.5 


10.3 


34.5 


21.8 


13.8 


E. 


Greet each other warmly 


25.6 


28.9 


32.2 


08.9 


04.4 


F. 


Complain about working conditions 


34.8 


18.5 


29.3 


10.9 


06.5 


G. 


Joke about difficuit situations 


25.3 


25.3 


38.5 


04.4 


06.6 


H. 


Discuss personal probiems with each other 


05.7 


11.4 


45.5 


22.7 


14.8 


1. 


Share teaching materials 


13.3 


16.7 


46.7 


12.2 


11.1 


J. 


Discuss suggestions for new school programs 


12.0 


15.2 


33.7 


20.7 


18.5 


K. 


insult other teachers directly (missing resp.-45) 


04.3 


06.4 


25.5 


23.4 


40.4 


K. 


Devekjp curriculum mater* lis together 


02.2 


11.0 


36.3 


20.9 


29.7 


L. 


Work on test construction together 


02.2 


04.4 


20.9 


16.5 


56.0 


M. Step In for other teachers in emergencies 


29.3 


34.8 


20.7 


12.0 


03.3 



16. Plaaaa circla tha appropriate numbar on tha 5-point acala to indicata tha dagraa 
of influanca aach of tha following factora, individual or groupa hava ovar 
daciaiona about tha achoora curriculum. 







•tot 




some 




Anost 
none 


A. 


indivkjuai teachers 


02.2 


10.1 


28.1 


21.3 


38.2 


B. 


Group5 or ckisters of teachers 


03.3 


13.3 


36.7 


20.0 


26.7 


C. 


Principal 


33.0 


28.4 


13.6 


12.5 


12.5 


D. 


TraditkMi (Missing rasp.-9) 


?2.9 


22.9 


27.7 


10.8 


15.7 


E. 


District level administrators (Missing resp.-g) 


34.9 


21.7 


15.7 


08.4 


19.3 


F. 


Central office administratois (Missing resp.<8) 


45.2 


14.3 


14.3 


06.0 


20.2 


G. 


School committee (Missing resp.-9) 


34.9 


20.5 


15.7 


04.8 


24.1 
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17. Pi«aM circle thm mpproprimte numbtr on tht S-point scmlo io indicmtt first how 
importmnt tmch itom is for your Job satisfmction, and Mcond. how wtil smtisfltd you mrs 
proMfitly with that upact 
of your Job. 



A. Sidary: 


Very Important 
Verysatlsfled 


47.8 
17.4 


29.3 
21.7 


19.6 
33.7 


02.2 
18.5 


01.1 
08.7 


Very l/nlmportant 
Very unsatisfled 


B. Job aacurity 


Very important 
Verysatislled 


82.2 
1 6.9 


10.0 
11.2 


04.5 
21.3 


03.3 
12.4 


00.0 
38.2 


Very l/nimportant 
Very umatisfled 


C. Laval of student 
achiavamant 


Very important 
Verysatlsfled 


80.2 
05.4 


12.1 

lao 


05.5 
35.9 


00.0 
27.2 


02.2 
18.5 


very IMmportant 
very iimatisfied 


0. Parant/taachar 
ralationships 


Very important 
Verysatlsfled 


79.1 
10.9 


13.2 
08.7 


03.3 
22.8 


01.1 
23.9 


03.3 
33.7 


Very l//iimportant 
Very tfnsatisfied 


E. TaacharAaachar 

ralatkMisNps 


Very important 
Verysatlsfled 


58.2 

oa7 


33.0 
20.7 


04.4 

43.5 


02.2 
12.0 


02.2 
15.2 


Very l/nimportant 
Very umatisfled 


F. Taachar/pupil 
ralatlonahips 


Very important 
Verysatlsfled 


91.2 
20.7 


0&8 
31.5 


00.0 
28.3 


00.0 
08.7 


00.0 
10.9 


Very l/nimportant 
Very u/isatisfiad 


GL Taachar/adntinistra- 
tor ralationships 


Very important 
Verysatlsfled 


75.6 
17.6 


ia9 

23.1 


03.3 
25.3 


00.0 
14.3 


02.2 
19.8 


Very Unimportant 
Very unsatisfled 


H. Tha cunicula in 
school 


Very important 
Very satisflad 


71.7 
09.9 


22.8 
22.0 


04.3 
38.5 


01.1 
16.5 


00.0 
13.2 


Very IMmportant 
Vary unsatisfied 


1. Taachar 

autonomy 


Very important 
Very satisflad 


53.9 
11.4 


34.8 
26.1 


09.0 
35.2 


02.2 
12.5 


00.0 
14.8 


Very (ynimportant 
Very unsatisfied 


J. Taachar authority 
ovar studants 


Very important 
Verysatlsfled 


73.6 
08.9 


24.2 
23.3 


02.2 
31.1 


00.0 
16.7 


00.0 
20.0 


Very l/nimportant 
Very unsatisfied 


K. Taachar evaluation 
procaduras 


Very important 
Verysatlsfled 


37.8 
11.1 


26.7 
11.1 


25.6 
41.1 


04.4 
14.4 


05.6 
22.2 


Very IMmportant 
Vary unsatisfied 


L Recognition for 
taachar acNavament 


Very important 
Very satisflad 


56.0 
06.7 


2a6 

18.0 


12.1 
25.8 


31.1 
25.8 


02.2 
23.6 


Very l/nimportant 
Very unsatisfied 


M.Paitidp«tionin 
maldng decisions 


Very important 
Very satisflad 


51.6 
04.4 


39.6 

07.8 


07.7 
41.1 


01.1 
25.6 


00.0 
21.1 


Very l/nimportant 
Very unsatisfied 


N. AdministratAi 
support In Improving 


Very impcs sent 
Verysatlsfled 


74.4 
12.4 


23.3 
22.5 


02.2 
33.7 


00.0 
15.7 


00.0 
15.7 


Very l/nimportant 
Very umatisfled 



student acNavement 
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18. PlttAM circle Xhm appropriate numbar on tha 5-polnt scala to Indicata firat how auccaasful 
you think thla achool haa baan wKh ragard to mmmtlna xtudmnt nmmda in tha araaa liatad balow. 
and. aacond. what priority you thinic your achooi ahould placa on that araa. If you dont l(now or 
if you hava no opinion, plaaaa laava tha itam biank. 



A. 


Taaching basic Htaracy skills 


vary succaasful 
Ngh priority 


11.4 
7Z1 


23.9 

las 


455 
065 


125 
023 


065 
012 


vary unsuccessful 
tow priority 


B. 


Taaching writing 
aach cat-fnissing 7 


vary succaasful 
Ngh priority 


11.8 
6S9 


22.4 

2ao 


44.7 

oa2 


14.1 
035 


07.1 
02.4 


vary unsuccessful 
tew priority 


C. 


Taaching mathamatics 
aach cat-missing 10 


vary succaasful 

Ngh priority 


20.7 

eajs 


22.0 
2^2 


42.7 
06.1 


095 
012 


04.9 

oao 


vary unsuccessful 
low priority 


0. 


TaacNng scianca 

suc-miss 12, prKfniss 11 


vary succaasful 
Ngh priority 


1Q0 
4a7 


275 
2a4 


412 

222 


10.0 
07.4 


112 
012 


vary unsuccessful 
low priority 


E. 


TaacNng social studlas 
suc-miss 12, pri-miss 13 


vary succaasful 
Ngh priority 


ISlO 
41.8 


3ao 

3Z9 


350 
20.3 


13.7 
025 


06.3 
025 


vary unsuccessful 
tow priority 


F. 


Taaching computar skills 
suc-miss IS, pri-miss 16 


vary succaasful 
Ngh priority 


36l4 
395 


195 
355 


312 
17.1 


10.4 
07.9 


02.6 
00.0 


vary unsuccessful 
tow priority 


G. 


Taaching thinkir.g skills 
suc-miss 10, pri-miss 9 


vary succassful 
Ngh priority 


14.6 


^S3 
16.9 


26i8 

oa4 


265 
072 


15.9 
03.6 


vary unsuccessful 
tow priority 


H. 


Taaching biBngual aducation 
aach cat-missing 32 


vary succaasful 

Ngh priority 


21.7 
3&0 


21.7 
183 


30.0 
21.7 


10.0 
10.0 


1&7 
1&0 


vary unsuccessful 
tow priority 


1. 


Taaching spadai aducation 
suc-miss 14, pri-miss 13 


vary succaasful 
Ngh priority 


21.8 
5&7 


385 
24.1 


282 
152 


06.1 
06.1 


0&4 
00.0 


vary unsuccessful 
tow priority 


J. 


TaacNng multicultural aducation 
suc-miss 17, pri-miss 18 


vary succaasful 
Ngh priority 


ia3 

3Sl1 


22.7 
25.7 


3&0 
215 


14.7 
095 


113 
08.1 


vary unsuccessful 
tow priority 


K. 


Taaching art and music 
suc-miss 19, pri^iss 21 


vary succassful 
Ngh prk>rity 


06.5 
26l8 


^22 
21.1 


26.0 
32.4 


192 
025 


37.0 
1&9 


vary unsuccessful 
tow priority 




suc-miss 20, pri-miss 19 


\#AffV siicrAftftfiil 

Ngh priority 


Mm it 

34.2 


32^ 


15t3 
205 


216 
04.1 


19.4 
062 


very unsuccessful 
tow priority 


M. 


TaacNng moral/atNcal vakjas 
suc-miss 14, pri-miss 13 


very successful 
Ngh priority 


14.1 
4&8 


10.3 
152 


24.4 
253 


23.1 
06.3 


2B2 


very unsuccessful 
tow priority 


N. 


TaacNng social courtasias 
aach cat-missing 12 


very successful 
Ngh priority 


1Q0 
45.0 


1Q0 
25.0 


XX) 
20i) 


225 
017 


zrs 

063 


very unsuccessful 
tow priority 


0. 


Promotirtg studanta self astaam 
suc-miss 9 


very successful 
Ngh priority 


15l7 
50.3 


21.7 

ia6 


36.1 
17.4 


195 
035 


072 
012 


vary unsuccessful 
tow priority 


P. 


Providing occupattonal 
couriMiing 

suc-miss 19, pri-miss 18 


very successful 
Ngh priority 


oa2 

29.7 


09.6 
23.0 


X.1 
27.0 


2&0 
122 


26iO 

oai 


very unsuccessful 
tow priority 


Q. 


Provkttng aducstiortal 

counaaling 

aach cat-missing 16 


very successful 
Ngh priority 


07.9 
3a2 


27.6 
315 


25i) 
155 


ia7 

105 


19.7 
03S 


vary Uiisuccessful 
tow priority 
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18. (ConL) Again, pl«aM circto th« •?propriato numt.r on thm S-poInt scal« to indieato first how 
succoMful you think this school has bssn with rsgard to mmmtina atudmnt nmmda In ths araas 
ilstad baiow. and sacond. what priority you thinic your achool ahould placa on that araa. If you 
dc^t Icnow or if you hava no opinion, piaasa laava tha itam bianic. 



R. MaMng raonw/corridors 
attrsctiva 



vary auccassftil 216 27.0 2ai 
Nghpriortty 409 3a0 1&2 



10. 1 112 vary unsuccassful 
0a4 045 lowpriority 



S. Providing gansral hsalth 
aducation 

auc-miss 12, prl^iss 14 

T. Providing nutritious maals 
pri-fnis89 



varysuccassful 100 2a7 2S.2 1&8 1&2 
Nghpriortty 305 34.6 14.1 07.7 06.1 



vsry succassful 244 23.3 23.3 04.7 
Ngh priority 422 24.1 19.3 02.4 



24.4 

12.0 



vary unsuccessful 
lowpriority 



very unsuccessful 
low priority 



U. Providing a drug aducation 
program 



vary successful 253 
Nghpriortty 54.0 



29.9 21.8 09.2 13.8 very uhsuccessful 
204 1Z6 01.1 06.7 lowpriority 



V. Providing an AiDS education 
program 

sucHfriss 12, pri-nniss 10 

W. Providing a sax education 
program 

auc-miss 16, pri-miss 9 



verysuccessftjl 102 2Q0 2Z5 108 225 
Nghpriortty 408 202 103 007 0O1 



very unsuccessful 
lowpriority 



very successful 
Ngh priority 



09.2 

:s.8 



11.8 22.4 209 27.6 very unsuccessful 
205 19.3 108 09.6 lowprtority 



X. Providing pregnancy counseling very successful OOO 10.7 107 20.0 42.7 
suc-miss 17. pri-miss 12 Ngh priority 307 20.0 20.0 1::5 107 



very unsuccessful 
lowpriority 



Y. Providiiig ratorrais to social 
service ager)des 

suc-miss 174)ri-mis8 13 

Z. Providing positiva role models 
each cat-missing 9 



very successful 22.7 21.3 34 J 10.7 10.7 very unsuccessful 
Nghpriortty 45.6 206 20.3 0&' 02.5 lowpriority 



very successful 21.7 3Z5 31.3 09.6 04.8 
Ngh priority 402 31.3 13.3 OOO 012 



very unsuccessful 
low priority 



a Providing a safe, orderly 
environment 



very successful 21.1 
Ngh priority 708 



40.0 14.4 122 122 very unsuccessful 

19.1 06.7 01.1 022 lowpriority 



b. Creating n caring environment 



very successful 207 
Ngh priority 609 



322 28.9 
102 10 2 



07.8 04.4 
04.5 01.1 



very unsuccessful 
low priority 



c. Showing concern for students' very successful 225 307 
personal needs Ngh priority 59.8 200 



32.6 0O7 045 very unsuccessful 
115 004 02.3 lowpriority 



d. Setting Ngh expectations 
for students 



very successfiil 14.6 201 345 14.6 07.9 
Nghpriortty 54.5 204 11.4 004 025 



very unsuccessful 
low prtority 
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«. Involving parants in 
student learning 



very unsuccessful 
lowpriority 



very successful 0a9 14.4 26.7 27.8 222 
high priority 5ai 22.1 06.8 06.8 oai 
345 

Your answers are rea^!/ important. Please keep going. And thank you! 



19. Please circle the appropriate number on the S^polnt scale to indicate how often 
you use the following methods in your teaching: 

almost 







aiot 




sometimes 




newer 


A. 


Teacher lecturing to the whole class 


17.0 


31.8 


35.2 


10.2 


05.7 


B. 


Teacher leading discussion among whole class 


23.6 


31.5 


38.2 


04.5 


02.2 


C. 


Teacher visiting snftaii groups within the dass 


32.2 


27.8 


22.2 


11.1 


06.7 


D. 


Teacher giving demonstration with equipment 


19.3 


23.9 


22.7 


13.6 


20.5 


E. 


Students giving presentations to the class 


03.4 


23.9 


29.5 


22.7 


20.5 


F. 


Students discussing problems in small groups 


12.5 


26.1 


29.5 


13.6 


18.2 


G. 


Students writing papers, stories, assignments 


4/ .2 


17.4 


23.3 


08.1 


07.0 


H. 


Students filling in worl(t)0Oi(S or exercise sheets 


202 


29.2 


37.1 


06.7 


06.7 


1. 


Students measuring, collecting data (Miss, rasp-9) 


10.6 


22.9 


31.3 


16.9 


18.1 


J. 


Students creating things (Missing resp.-11) 


23.5 


22.2 


29.6 


11.1 


13.6 


K. 


Students woriting in laisoratories (Miss. resp.-18) 


12.2 


08.1 


05.4 


04.1 


70.3 


L. 


Students taldng supervisied field trips (Miss resp-8) 09.5 


10.7 


33.3 


15.5 


31.0 


M. Students working ail on the sama les.ton 


26.4 


23.0 


36.8 


03.4 


10.3 


N. 


Students walking about the room (Missing resp.-7) 


04.7 


09.4 


30.6 


18.8 


36.5 


0. 


Whole class working together 


31.5 


23.6 


39.3 


03.4 


02.2 


P. 


Students working on a project of their choice 


11.5 


20.7 


41.4 


14.9 


11.5 


20. How important are each of the following factors in 
for your students? 


determining teaching objectives 






veiy 

important 




xwreM^ist 
Importaf^ 




u/Tnpnrtart 


A. 


School policy 


2B.1 


2^3 


303 


12.4 


075 


B. Student interest 


A22 


31.1 


ia7 


10.0 


00.0 


C. 


indivklual student ability 


57.1 


31.9 


077 


033 


00.0 


0. 


Your personal preference 


15.9 


29£ 


39u8 


11.4 


03.4 


E. 


Available textbooks 


42.7 


23.6 


1&7 


10.1 


075 


F. 


Other available resources 


38.6 


23.9 


2&1 


063 


04.5 


G. 


What wW be tested 


21.6 


2S.0 


352 


0&7 


125 
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21. Clrc]« Xhm appropriate numbar on tha 5-point scala to indicmta tha dagrae to which 
aach of tha following bahaviors ia typical of studants in your school. Also, plaasa give 
a racant axampla of aach. 

navar happana vary typical 



A. Sludant volurttaaring 

Exampla: (Missing raap.- 11). 



03.7 14.8 21.0 27.2 33.3 



B. Studant Involvamarit In dacision making 23.7 21.2 31.3 17.5 06.3 
Exampla: (Missing rasp.- 12) 



C. Taidng cara of school proparty 
Exampla: 



0. TolaraUng othars 
Exampla: 



E. Maldng friandships across racial 
and alhnic groups 
Exampla: 



F. Showing raspact for taachars 
Exampla: 



G. Showing appraciation of taachars 
Exampla: 



H. Showing intarast in learning 
Exampla: 



1. Helping other students iaarn 
Example: 



J. Participating in extracurricuiar activities 
Example: 



10.3 25.3 44.8 12.6 06.9 



01.2 18.6 53.5 19,8 07.0 



01.1 n,8 31.8 23.9 28.4 



03.4 23.9 43.2 20.5 09.1 



10.1 27.0 37.1 15.7 10.1 



03.4 22.5 46.1 20.2 07 9 



03.4 11.4 52.3 22.7 10.2 



01.2 15.1 45.3 26.7 11.6 



K. Complimenting other students for 
goodwortc 

Example: 



06.9 34.5 31.0 19.5 08.0 
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22. Circle th% appropriate t^umbar on the S-point acala balow to indicata tha dagraa to 
which aach of tha following f^ahaviora la typical of atudanU in your achool. Alao. 
plaase giva a racant axampla of aach. 

no pfoblanV 

navar happens vaiy typical 

A. Stealing 04.5 35.2 27.3 17,0 15.9 

Example: 



B. Destruction of school property 02.2 25.8 27.0 22.5 22.5 

Example: 



C. Sax offences 22.1 42S 26.0 033 05.2 

(Missing responses - 15) 



Example: 



D. Impertinence and discourtesy to 023 11.5 2^B 293 345 

tsachers 

Example: 



E. Meanness and bullying between students 01.1 las 3a7 34.1 205 
Example: 



F. Fighting OOjO 22.7 352 233 182 

Example: 



G. Racial incidents 165 435 29.4 0a2 02.4 

(Missing responses - 7) 



Example: 



H. Truancy 023 195 32.6 24.4 203 

Example: 
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noproblarrV 
never happens 



very typical 



I. Physical violence against teachers 
Example: 



J. Using profane or obscene language 
Example: 



K. Using illegal drugs 
(Mining responses - 17) 
Example: 



L Drinidng alcohol 

(Missing responses - 19) 
Example: 



M. Cheating on tests 
(Missing responses - 9) 
Example: 



N. Craating classroom disorder or 
chaoa 

Example: 



O. Smoking in school 
(Missing responses - 14) 
Example: 



11.1 47.8 30.0 08.9 02.2 



02.2 14.6 20.2 19.1 43.8 



29.3 38.7 21.3 04.0 06.7 



42.5 35.6 15.1 02.7 04,1 



03.6 28.9 41.0 19.3 07.2 



04.5 20.5 33.0 23.9 18.2 



30.8 51.3 11.5 05.1 01.3 
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23. Whatt is your Job? Ptaasa rank ordar tha followir^g in tanms of thair importanca. "1" baing most important, 
"5' baing laast important. 

1. to halp studants laam 

1: 79.5 2: 11.4 3: 04.5 4: 03.4 5: 01.1 

^ 

^ ]^ 2. to ba a friand to studants (Missing rasponsas • 10) 

^ 1: 02.4 2: 15.9 3: 24.4 4: 46,3 5: 11.0 

3. to taach valuas to studants (Missing rasponsas - 14) 

1: 11.5 2: 60,3 3: 21.8 4: 06,4 5' 00.0 

4. to \MkB cara of studants (giving counsaling, madical, social, or othar sarvicas) 
(Missing rasponsas- 19) 

1: 12.3 2: 17.8 3: 37,0 4: 30.1 5: 02.7 

5. othar plaasa spacify , (Missing rasponsas - 73) 

1: 21.1 2: 05.3 3: 15,8 4: 10.5 5: 47,4 

24. What do you think your job shouM ba? Piaasa rank ordar tha following in tarnrtt GfifyBlr importanca, 
"r baing^most important "5' baing laast important 

^ 1. to halp studants laam (Missing rasponsas - 7) 

• ^:85.9 2:09.4 3:02.4 4:01.2 5:01.2 

2. to ba a friand to studants (Missing rasponsas • IS) 

1: 02.6 2: 13.0 3: 29.9 4: 46.8 5: 07.8 

3. to taach valuas to studants (Missing rasponsas * 17) 

1: 09.3 2: 65.3 3: 18.7 4: 06.7 5: 00.0 

4. to taka cara of studants (giving counsaling. madical, social, or othar sao/icas) 
(Missing rasponsas-22) 

1: 04.3 2: 12.9 3: 45.7 4: 31.4 5: 05.7 

5. othar plaasa spacify, (Missing rasponsas - 74) 

1: 16.7 2: 16.7 3: 05,6 4: 16.7 5: 44,4 




25. What do you think tha principal's Job should bs7 Ptaasa rank ordar tha following in tamis of thair 
importanca, 'V baing most important, '5' baing laast important. 

1. to disciplina tha studants 

1: 10 5 2: 16.3 3: 15,1 4: 20.9 5: 37.2 

2. tosuparvisathataachars (Missing rasponsas - 7) 

1: 09.4 2: 10.6 3: 25.9 4: 31.8 5: 22.4 

3. t > laad curriculum and program planning (Missing rasponsas - 7) 

1: 21.2 2: 32.9 3: 25.9 4: 11.8 5: 08.2 

4. to ovarsaa school oparations and schaduling (Missing rasponsas * 8) 

1: 58.3 2: 22.6 3: 10.7 4: 07.1 5: 01.2 

5. to provida rasourcas to taachars (Missing rasponsas - 15) 

1: 09.1 2: 26.0 3: 26.0 4: 22.1 5: 16.9 
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26. Raasarmnk order what you like most about teaching in this school? 

1. the students FIRST 
Z the teachers SECOND 

3. the principal THIRD 

4. the physical envirorment TIED WITH 'OTHER* 

5. other please specify. TIED WITH 'PHYSICAL ENVIRONMENT 



27. Please rank order what you wouki like to change in this school? 

1 . student assignments SECOND 

Z the teaching staff FOURTH 

a Iheprindpai THIRD 

4. the physical erK<ronment FIRST 

5. other, please spedfy. RFTH 



.28. Do you particpate in planning and deciston making when you have the opportunity to do so? 
(Missing responses - 8) 



never slot 

06.0 04.8 41.7 22.6 25.0 

29. Do you participate in committees within your school besides ckister meetings? 
(Missing responses * 7) 

never slot 

20.0 14.1 25.9 22.4 17.6 

30. Do you participate in district or system wide committees? 

never a lot 

40.7 26.7 20.9 04.7 07.0 



31 . How re these opportunitias comunicated to you? Please check ail that apply. 

1. word of mouth (other teachers) (82.6 ) 
Z staffmeetings (75.0 ) 

3. loudspeaker/Intercom {522 ) 

4. notices posted on a tx)ard (38.0) 

5. mass mailings to all teachers (16.3) 

6. personal request or invitation by leader (5.4 ) 

7. other ( 1.1 ) 



32. Do you participate in any professional development activity outside of your work for the Boston Public 
Schools? 

Yes (56.3 ) No (43.8) Missing responses - 12 
If yes, please specify 
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33. Do you think this middle school has soma special characteristics distinguishing It from other middle 
scfioois? 

Yea (77S ) No (22.1 ) Missing responses- IS 

b. If yes, would you please note briefly what you think those characteristics are? 



34. Please provkie any other conrvnents which you think should be added to this questionnaire. 



YouVe finishedl Thanks a lot! You'll be hearino from us with the results. 
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APPENDIX A.3 



cXAMPLES OF PROSCXDIAL AND ANTISOCIAL STUDENT BEHAVIORS 
PROVIDED BY TEACHERS IN THE TEACHER QUESTIONNAIRE 



PART I: PROSOCIAL BEHAVIORS 



Student Volunteering 

-Student Council projects 

-Baking, decorations, Valentines 

-Local nursing home, Aids unit, Pine St Inn 

-Multicultural festival-students doing flowers, dressing, all voluntary 

-A boy asking me if he codd do a puzzle map of South America 

-To ^xk in cafeteria 

-A girl volunteered to take a message to the dean. 
-Decorations for hall bulletin boards 
-Pass out work 

-Open House, Evening Escorts 

-Students in dass often volunteer to help teacher 

-Keeping school dean* 

-Students voluntarily partidpate only after they have been promised a reward 

-Decorate the auditorunrin fuiother school/talent show 

-Water at Boston Maratfx)n * 

-To run errands, to answer questions 

-Students are eager to volunteer sometimes for attruistic reasons but often times to 
enhance their own self-esteem 
-Volunteers for oratorical contest 

Student Involvement in Decision Making 

-Student Coundl representatives 
-Change in schod fomiat. No students asked. 
-Dedding test date 
-They are too in'esponsible 

-Many seem to like and k}e able to cooperate to make dedsions as a class, re: 
projed theme 

-Vote on how will do an assignment 
-Community meetings 

-Student discussion to solve problems*, debates 
-Where to go on field^ps/where to eat on fieldtrips 
-How to decorate dassroom 



» 
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Taking Ca.e of School Property 

-Books still suffer while graffiti has gone down 
-Bathroom dean up 
-Aranging desks, washing floor 
-Willingness to dean room 
•Cleaning schoor 
-Voluntary painting 

-Students deaning before Open House 
-Cleaning^^ up painting 

-Using computer, each student is responsible for the computer he or she is using. 
It is checked after each dass. 
-Caring about each other 
-Only if asked to pick up paper, etc. 



Tolerating Others 
-Refrain from fighting 

-Asking one person tr ^rx together with another 

-Live and let live is the usual attitude although there is the one boy this year who is 
the 'goaf 

-Within my dass, students are tolerant of acting out behaviors of one particular 
boy. 

-A group of students allow a non-English speaking child to receive help in English 
while they work alone daily. 

-At least seem to know or say 'Let's get along' in presence of teachers. Observed 
some cruel pupil to pupil interactions 
-Rare arguments 
-Pupils ignore wise cracks 
-The kkjs seem to get along well 
-When a death in family 
-Ignoring difficult behavior 
-Helping others with social problems 
-Yes, for the sake of a peaceful fmvironment 
-This is subjective, rather objective. Cannot generalize 

Making Friendships Across Racial and Ethnic Groups 

-School has been integrated for over 20 years. Its no big deal 
-Field trips, dass activities and mainstream activities 
-I see it all the time 
-White-black friends 

-I sometimes choose children from different ethnic backgrounds to work together 
-These seem to last only during the school day. Only one or two inter-radal 
relations seem to endure outside of school 
-Except with Vietnamese*they keep to themselves 
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-New girl (black) and Hispanic girl are friends. Latter one has shown former one 
around bidg. and they anive at dass together 
-Rarely done 
-Sc"ie progress 

-Students not racially problematic 
-My classes are mixed ethnic groups 
-All races work together on a project 
-Especially after classes on racism 
-Helping one another with a difficult lesson 
-Sports 

-Black/hispanic relationships occur but no black/white. Wack/vietnamese occur 
-In classes, in shows 

-Students help with projects and share ethnicity during dass 
-Black arxJ white friends-calling home, exchanging numbers 
-Peer racial harmony 

-Depends upon rapport students have with each other. Not a conscious decision 
-Yes, from what I've seen-no radal problems 

Showing Respect for Teachers 

-Most students greet teachers respectfully 
-Saying please when asking for something 

-50-50-Some are excellent, others answer the teachers in rude, obnoxious 
manners 

-A studerrt complimented a teacher on appearance 
-Observed and experienced some 
-No prot)lems 
-Hold door, say hello! 

-Disrespectful in tone and choice of address (Man! Yol) 

-Again moderating behavior when teacher returned after a death in family 

-Wori<ing together 

-Speak when spoken to, listen to teacher 
-When demanded 

Showing Appreciation of Teachers 

-Classroom disruption 

-Students gave me flowers for Mother's Day 

-Helping 

-Bringing in plants/flowers 
-Concern over impending lay-offs 
-Never! 

-K!dding around (tongue-in-cheek) about age, gray hair. etc. 
-A studertt gave a Christmas card to a teacher 
-Visits after graduation 
-Say thank you! Smile 

-They enjoy to learn about other talents you may have. 

-Thanking for a dass 

-Kids saying Thank-you' for fieldtrip 
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-Offer to make get well or thank you cards & B-day 
-Some small gifts, chips, candy 
-With good behavior 

-Sometimes seen a student hugging a teacher 
Showing Interest in Learning 

-Otner kids asking to attend field trips/speakers for my classes 
-Volunteering for special projects 
-Those who wish to go to an Exam School 
-My students show some interest 

-A group of four students follow directions, respond and do assignments. They all 
have a good disposition and are seldom cantankerous 
-6th graders especially eager 
-Advanced class projects 
-Love to win prizes, get into Latin etc. 

-These kids do not want to leam. All they talk is sex. basketball, fighting and sex. 
-Active participation in dass 

-Excited when the computer tells them they have done a good job 
-Doing work 

-Wanting to leam another language 

-Sitting attentively 

-Yes. with lesson completion 

-Very oftentimes students are easily distaracted & learning is put at the bottom of 
their agenda 
-For Science fair projects 

Helping Other Students Learn 

-Work in group and individual work projects 

-In cooperative learning, tiiey help each otiier a lot^ 

-Wang Lab 

-A group of of our stijdents often assist each other in understanding words and 
sharing dictionaries. 

-Quite willing to share knowledge of computers 
-Peer tutoring 

-Often help each otiier in writing 

-Some bilingual kids help otiier kids witii tiieir Spanish 

-Worthing in group projects 

-Student volunteering to help others who are having difficulty 

-When one student finishes finishes tiieir work, sometimes helps another 

Participating in Extracurricular Activities 

-Sports, Dance Program 
-Field Trips 

-Lots of stijdents in festival, talent show. team,... 
-Baseball dub. tiip to Fenway Pari< 
-Basketball & ti^ack.' Need much more' 
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-Sports^* and dubs 
-Computer club** 

-Track; film dub; sports/interscholastic 
-Basketbair* enthusiasm 
-After school ACT Program 

-Generally students enjoy after-school sports; 2. chance to release energy in a 
constructive way 

K. Complimenting other students for good work 

-Written Awards. Certificates. Audio visual activity 

-Several kids pass to Latin School. No students say anything to those going. 
-If wori^ is neat. I shew dass paper as example of what work should be, or I 
compliment the person 
-Clapping for winners of contests 
-Recent competitions 
-IVe never seen it* 
-When tests are retumed 
-Some, more resporxj by copying 
-Rare 

-Clap when one or other pupils win an award 
-Talent show, exciting hair-do 

-Yes. saving a piece of artwork is good even though they didn't like the student 
who did it 

-Support* and encouragement 
-Compefitive lesson achievement 
-Everyday in my room 



PART II: ANTISOCIAL BEHAVIORS 



A. Stealing 

-Money** and objects from parents 

-Money fron teachers' wallets 

-Had some camera film stolen from me yesteiday 

-$50 stolen from 8th grade fund 

-Stealing white lined paper 

-Others' pendls**-money*-even a teacher s sandwich 

-Other studonts' supplies. VCR. tape recorder 

-Pens, magic markers, etc.. were removed from an absent teacher's desk 

-Calculators 

-Very seldom 

-Not often in my das;i. but does happen in school 
-Ghost will pocket ary undaimed property/money 
-Teacher's wallet 
-Children's work 

-My phone has been stolen, money, computers from school, numerous break-ins 
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-Teachers' bags 

-Keep pocketbook in mickjie of desk so dishonest ^/Od honest student keep an eye 
on it 

-A teacher's leather coat was stolen 
B. Destruction of Scl^ool Property 
-oraffiti 

-Books, grafi'ti on school walls^^ classroom glass doors 

-Many textbooks have pages torn out 

-We have very distructive kids in the building 

-Write on desks"^"-No care of books", will write or tear them, lose them- Write 
on walls^ 
-Rare graffiti" 

-Broken windows, graphity, etc. 
-Destroying pencils, wasting paper 
-My office was destroyed last Sept. 



C. Sex Offenses 
-Hands all over pretty giris 

-Obscene jestures, touching/rape and obscene knguage 

-Last was in December, two boys rTX)l6Sted a giri 

-Patting giris on breast or fanny-obscene remari^ and pictures 

-Boys touching giris" while filing^ 

-Have seen leuod behavior 

-Verbal and occasional unwarranted touching 

-It seems to be a game among them 

-Touched a stafTs breast 

-Feeling another student in privcte placesV verbal suggestions 

-Inappropriate gestures* 

-A giri was raped on the way to school 

-Once a student of mine was coming down Jie stairs, a boy pushed her into the 
auditorium and felt her breasts 

D. Impertinence and Discourtesy to Teachers 

-Disrespectful in tone and choice of address (Man! Yo!) 

-Lot of mouthy behavior by even best kids toward teachers they don t know 

-Punching and kicking doors 

-Shouting at teachers and answering with sarcastic remari<s 

-Name calling 

-Use of foul language 

-I have been asked to Fuck myself on various occasions 
-Students try their best to abuse teachers 

-Constant teacher baiting-typical "You didn't tell me not to dc it-you told him' 
-In classrooms & hallways especially toward teachers who they do not have 
in dass. 
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-Every day! 

-A boy swore at a teacher in Spanish. He said the equivalent of 'ass hole' 
-Lots of back-talk when reprimanded and general bad attitude toward adults 
-Refusing to throw gum away 

-Regular teachers have no problem. Substitute teachers have problem^ 

-With regards to gum/fighting 

-An attitude of disrespect toward all authotity 

-These kkls h^^e no manners 

-Tuck you'^ 

-Telling teachers to shut-up^ cursing teachers* 
-Bad mouthing 

Meanness and Bullying Between Students 

-Some students calling each other names, making fun of the way he or she 
dresses 

-One good slap deserves another is the motto in this school 
-Lots of *he said, she said' meanness that leads to fights/argumer. . among some 
of our giris 

-Threats, vert>ai assault 

-One kkj hit other in face opening skin because of a rumor 
-Constant extortion of moiiey 
-Especially during filing 

-A boy in the lunchroom kept pushing another bey in the face 
-Especially in lab and sub. sep. classes who see one another all day and don't 
changa d^es 
-Not regulariy* 
-Towards shy types 

-Unless constantly observed and nrtonitored and disciplined 
-Giris beating small boys 
-Throwing a kid down a staircase 
-Pushing, grabbing others 

-Kids are mean to others especially when not v^earing the right clothes 
-Saying mean thhgs loudly 
-Capping 
-Just tease-f; uso 

Fighting 

-Almost daily* 

-A boy was suspended for fighting with a giri. He hit her. punched and kicked her. 

-Not too often. More verbal than physical competition 

-Fighting over girlfriends 

-Usually outside of school 

-Peer pressure, petty jealousies 

Occasionally over a silly problem 

-It is 9 way of life, but not excessive 

-Everyday practice 

-Fighting because c' trivial r9asons^ 'She looked at me wrong' 
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-Gang wars planned after school 
-Once in a while 

Racial Incidents 

-Youngsters from P,R, and Dominican Republic challenge each other, fight outside 
school, racial slurs 

-Hispanic and black girls fighting in gym arid shop. They don't like way other 
walks, or dresses. ... 

-Asian slurs are frequent-directed at Asians by white/black/hispanic 

-Spanish/Vietnamese. Spanish/Black. BlackA/ietnamese 

-A black boy and a Puerto Rican boy called each other 'nigger and 'spic' 

-Haven't witnessed physical confrontations but hear some put-downs 

-Rare, but if it takes place it is usually between black pupils 

-I have never seen that 

-Students when angry acaise students of racism 

-Open insult 

-Not much anymore 

Truancy 

-Barents cover for kids and/or have no control and don't initiate action. School 
must. 

-Babysitting younger brother or sister or working 
-Marcos cut homeroom yesterday 

-Parents don't care or have no control and/or nothing of any consequence is done 
to parent or stuient. 

-Luz Quiles (14) lives with her boyfriend, mother doesn't know address 

-Not sure how much is excused as absences, same kids at risk 

-One student has attended only 3 of last 50 school days 

-Students rarely are truant 

-Late, absent with no excuse note 

-One student comes to school when feels like it 

-Hiding from class 

-One student was absent a lot 

Physical Violence Against Teachers 

-Punching and hitiing, throwing objects 
-One tead'^r was hit by student 

-If teacher should demand a student to do something he doesn't wish to do, will hit. 
punch or push 
-Within my own classroom 

-A boy pushed the teacher when she tried to straighten the standing board which 
he hr^ pushed aside. 

-Breaking up fights is risky. Verbal threats heard, have seen no contact 
-Some classes, especially SPED 
-3 or H court cases this year 
-A student kicked me once 
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-Restraint necessary 

-Once I got hit trying to stop a fight 

-Outof sdnod 

-Many times teachers have t>een hit or bitten 
Using Profane of Obscene Language 
-Fuck you, Mother Fucker 

-In dass when there is an argument between students 
-Boy telling girl Tuck You', Sent for parent. Seems to be a problem which is 
increasing! 

-This is part of everyday speech 

-It is part of a normal conversation which that they hear at home 
-Almost seems like its part of the school cumculum 

-It can be heard when the students come out of school at dismissal. Such words 
as "fuck" and "suck" are common, 

-ConstartUy without even knowing what they're saying-not just in anger either. 
^ Jonidors are filled with obscene dialogue between students 
-Anger situations 

-Try to not let this happen by not allowing pupils to speak when angry 

-Even "nice" girls routinely use the common obscenities (not mild ones either!) 

-Fuck you% suck my dick 

-Swearing at teachers, I'm going to wreck you 

-Swear words to friends 

-Like breathing 

Using Illegal Drugs 

-Cigarettes, inhaling from pen tube 
-Outside sdiool, is happening a lot 
-Hard to prove 

-Some do but not in school, that I know of. 
-Question use by a few students, hear some talk of it 
-Only hearsay 
-Lunch 

-A lot of kids use or deal drugs 
Drinking Alcohol 
-Smell of alcohol 

"Outside school. Minors can buy alcohol and cigarettes in streets 
-Before school 

-Seems familia'' to many in discussions or off hand comments 

-Hearsay "IVe got a hangover" 

-Not usually in school but many times the night before 
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Cheating on Tests 

•Kids don't know asking questions of each other 

-Look at someone else's answer or talking 

-Sometimes a chikJ will open a Idool: inside desk 

-Looking on another's paper or giving the answers to another 

-They don't care 

"Not olDserved, as they are watched 

-I lave caught several 

CXxasionally* 

-In competitive situations 

-Apathy prevails over disposition 

-Copying papers 

-Spelling 

Creating Classroom Disorder or Chaos 

-Depends upon teacher 
-Running and yelling 
-Sometimes students with pens 

-Sit on desk-waik around the room-yell at teacher- then ignore the teacher* when 
reprimanded-this happens when the rest of the dass enjoys the diversion 

-Especially with inexperienced teachers. They're not he^e to learn, theyVe here for 
a free lunch! 

-Passing notes 

-Same kids, every dass has some 

-If called to office, dassroom is unattended 

-Lower academic levels 

-Usually remove studem to another room 

-Spedal Ed. kids can be repetitive 

-FartingV laughing, etc. 

-Talking loudly, being disruptive 

-Looking out windows, walking around 

-Talk a lot 

Smoking in School 

-Anti-smoking campaigns are working 

-Bathrooms a:Ki buses 

-Never encountered this 

-Have seen none 

-A handful of students 

-Hearsay! 

-Usually not during school 



Mtems marked with one or more asterisks were mentioned by several teachers. 
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cfwnni rT TMATir STTIPY 

This questionniire is pm of i study beinf cmied out to Itua mote iboui what it is 
like to be t studeot in i middle tehool. 

PLEASE ANSWER THE FOLLOWING QUESTIONS BY CHECKING THE BOX NEXT 
TO THE CORRECT ANSWER OR FILLING IN THE BLANK. IGNORE THE 
BRACKETED NUMBERS ON THE LEFT. 

(12] 1. Are you male or female? ( ) 1. niale ( ) 2. female 
(i3].[i4] 2. How old are you? years old. 



(15],(16] 



3. What race/ethnic group(s) do you belong to? 



) 1. Asian 

) 2. Black 

) 3. Caucasian (white) 

) 4. Hispanic 

) 5. Native American 

) 6. Other, please specify 



(ni.(ui.ti9) 4. How many years have you been at this school? years 



(201 5. What grade are you in? 

( ) 1. Sixth grade 

( ) 2. Seventh grade 

( ) 3. Eighth grade 

i2ii.(22].(23] 6. Check if you are in any special program in this school? 

( ) 1. No 

( ) 2. Bilingual 

( ) 3. Lab Gass/ Cluster 

( ) 4. Special Education - Resoarce Room 

( ) 5. Advanced Work Class 

( ) 6. Chapter 1 - Reading 

( ) 7. Chapter 1 - Math 

(. ) 8. Targeted Reading 

( ) 9. Sports 

( ) 10. Other; please specify 
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7, Do you think it is important to come to school? 



( ) 1. Yes 
( ) 2. No 



t2si 8. How do you get to school on most days? (Check ONE answer only) 

( ) 1. School bus 

( ) 2. The T 

( ) 5. Car 

( ) 4. Walk 



i26].[27].(2si 9. Check the three (3) most important reasons why you come to school. 



) 1. To learn 

) 2. To see my friends 

) 3. To get into college 

4. To participate in sports 

5. To get a job in the future 

6. To get breakfast and lunch 

7. For something to do 

8. Because my parents make me 

9. Because it's nicer than home 

) 10. Because I like a certain teacher 

) 11. Because I like a certain class 
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10. In general, are you happy about your life' 



( ) 1. Yes, very much 
( ) 2. Yes, sometimes 
( ) 3. No, not at all. 
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(301 .(551 1 1 . How do you spend most of your time after school? (Write the 

number of hoars on the line next to each activiry. If no hours, wnie 0.) 

1. Work outside the home 

2. Do chores 

3. Do homework 

4. Af terse hool program 

5. Watch TV/videos 

6. Play video games 

7. Go out with my friends 

8. Read 

9. Play sports 

10. Take lessons (dance, art, music, language, etc.) 

11. Play music 

12. Hang out 

13. Other, please specify '. 



12. How do you spend most of your time on weekends? (Write the 

number of hours on the line next to each activity. If no hours, write 0.) 



1. 


Work outside of the home 


2. 


Do chores at home 


3. 


Do homework 


4. 


Watch TV/videos 


5. 


Play video games 


6. 


Hang out 


7. 


Go to the mall/shopping 


8. 


Go to the n.ovies 


9. 


Go to church, temple, or mosque 


10. 


Play sports 


11. 


Take lessons (dance, music, language, etc.) 


12. 


Play music 


13. 


Oth^r; plpaqft specify 
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13. How did you spend most of your time last summer? 
(Check three(3) ways) 



) 1. Work outside the home 

) 2. Help around the house 

) 3. Go to summer school 

) 4. Go to camp 

) 5. Play sports 

) 6. Travel 

) 7. Stay home 

) 8. Watch TV/videos 

) 9. Play video games 

) 10. Kang out 



) 11. Other; please specify 
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14a. Do you have a job outside the home? 



[851.(861 



( ) 1. Yes 

( ) 2. No (If no. please go on to question if 15 a) 



14b. If yes, how many hours do you work? 



hours/week 



[871 15a. In the last year, have you done any volunteer work 
(helping a good cause for no pay)? 

( ) 1. Yes 

( ) 2. No (If no, please go on to question ifl6) 

[$»] 15b, If yes, what was it? 

189] 15c. If yes, how many times did you do it? 

( ) 1. Weekly 

( ) 2. Monthly 

( > 3. A specific number of times. How many? 
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16. My parents (or guardians) think that school is: 



( ) 1. Very important 
( ) 2. Important 
( ) 3. Not important 



[91]- [93] 17. Have your parents (or guardians) visiteJ the school this year? 



( ) 1. Yes; why? _ 
( ) 2. No; why not? 



(9*).(9S) 18. What language or languages do you speak at home? 



(96]. (98) 19. Check the three (3) most important adults in your life. 

) 1. Mother 

) 2. Father 

) 3. Oiher relative; who? 

) 4. A teacher 

) 5. A coach * 

) 6. Other; who? . 



[99].[100) 



20. What are most of your grades like in your classes? 



) 1. 
) 2. 
) 3. 
) 4. 
) 5. 



A's 
B's 
Cs 
D's 
Fs 
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21. What do you think the teacher's job is in this school? 
(Check the three(3) most important things.) 



) 1. To help us learn 

) 2. To be our friend 

) 3. To teach us right from wrong 

) 4. To take care of us 

) 5. To make us behave 

) 6. Other; please specify 



22. What do you think the principars job is in this school? 
(Check the three(3) most important things.) 

( ) 1. To run the school 

( ) 2. To help the teachers 

( ) 3. To help the students 

( ) 4. To make students behave 

( ) 5. To be the teachers' boss 

( ) 6. To make sure that students are safe 

( ) 7. Other; please specify , 



-[jo9! 23. What do you think the student's job is in this school? 
(Check the three(3) most important things.) 



) 1- 


To get an education 


) 2. 


To learn about other cultures 


) 3. 


To get along with others 


) ^• 


To do my best 


) 5. 


To study hard 


) 6. 


To help others 


) 7. 


To help make decisions in school 


) 8. 


CithfT' please specify 



7 



24. If you had a serious personal problem, is there any adult in 
this school you would go to for help? (Check ONE answer only) 

( ) 1. No 

( ) 2. Teacher 

( ) 3. Guidance Counsellor 

( ) 4. Nurse 

( ) 5. Director of Instruction 

( ) 6. Principal 

( ) 7. Coach 

( ) 8. Other; please specify 



25. Are the rules of discipline of this school clear to you? 
( ) 1 . Yes ( ) 2. No 



26. In the last year, have you been suspended? 
( ) 1 . Yes ( ) 2. No 



[113] 



15] 27. What does this school expect you to do? (Check three(3) things) 

( ) 1. To study hard 

( ) 2. To get along with others 

( ) 3. To do my best 

( ) 4. To get good grades 

( ) 5. To help others 

( ) 6. To behave 



28. In the last year, have you 

( ) 1. Never 

( ) 2. Sometimes 

( ) 3. A lot 



been punished by your teacners? 
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29. How do most teachers in this school punish students? 
(Check ONE answer only) 

( ) 1. F^eep students after school/class 

( ) 2. Give students extra work 

( ) 3. Send students to the principal's office 

( ) 4. Keep students from recess and gym 

( ) 5. Talk to students privately 

( ) 6. Talk to students in front of everyone 

( ) 7. Yell at students 

( ) 8. Other; please specify 



(J18] 30a. In the last year, has the school presented yea with anything 
for doing well? 

( ) 1. Yes 

( ) 2. No (If no, please go on to question #31 ' 

[119] (1211 30b. If Yes, what was it for? 

( ) 1. Academics 

( ) 2. Sports 

( ) 3. Music 

( ) 4. Art 

( ) 5. Drama 

( ) 6. Oiher; please specify 



31. Check the special things teachers do for students when they do well. 

Check all that apply) 

( ) 1. Give out small but fun prizes 

( ) 2. Put up my work in the room 

( ) 3. Send nice letters home 

( ) 4. Write nice comments on tests and homework 

( ) 5. Other; please specify 
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(1271 32a. Have you been rewarded by your teacher for doing well? 
( ) 1. Yes 

( ) 2. No (If no, please go on to question if33) 

lilt] . (130) 32b. If yes. what was it for? 

( ) 1. Classwork 
( ) 2. Homework 
( ) 3. Tests 
( ) 4. Good conduct 
( ) 5. Helping out 

( ) 6. Other., please specify 



[131]- [133) 33. Do you like to come to school? 



( ) 1. Yes; why? _ 
( ) 2. No; why not? 



[i34]- ii36j S4. Do you feel safe at school? 



( ) 1. Yes; why? . 
( ) 2. No; why not? 



You're doing a great job! Keep going! 
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35. Please circle the number below to show how important 
the following items are to you. 



noi 
important 



sort ot 
important 



ry 

important 



1137] A. Family 



131] B. Being rich 



1139] 



C Friends 



[140] D. Future education 



1141] E Having fun 



(142] F. Getting good grades 



iio] G Feeling safe 



[144] R Helping others 



145] I. Having a job now 



146] J. Future job 



5 



4 5 
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36. Please circle the number below to show how students 
act in your school. 



(U7) 

tut] 

[1*9] 

tISO] 
[151] 



nJ21 
I1S3] 
tlS4] 

US!] 

(156] 

[1J7] 

1151] 

1:59] 

(160] 



happtmt 



happtns happens 
sometimes a lot 



Students: 

A. Help out at school 

B. Help plan school activities 

C Take care of school 
property 

D. Get along with each other 

E Make friends with 
students of other 
racial/ethnic groups 

F. Show respect for teachers 

G Help other students learn 

R Get into school activities 
and clubs 

I. Compliment other 
students for good work 

J. Help make class rules 

K Decorate classrooms 
and halls 

L. Help other students 
with personal problems 

M. Make friends with students 
who are new to the school 

N. Help students who don't 
speak English talk to others 



2 
2 
2 

2 

2 

2 
2 
2 



3 
3 
3 

3 

3 

3 
3 
3 



4 
4 
4 



4 
4 
4 



5 
5 
5 

5 

5 

5 
5 
5 



ERIC 



3^5 



12 



(I6I1 



37. Please circle the number below to show how you feel 
about the following items. 



In this school, students: 

A. Steal things from others 



happtms 



happtns happtns 
somttimts a lot 



rj62] B. Destroy school property 



(1631 C Write graffiti (write on walls) 



[i6«] E Bad-mouth other students 



165] F. Bully other students 



166] G Fight with other students 



[167] K Make racial insults 



[161] I. Tease students who get 
good grades 
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38. Please circle the number below to show how you feel 
about the following items. 



In your school, students: 
A. Cut class 



mtvtr happtns happens 

kapptnt sometimes a lot 



[170] B. Cut school 



[171] C Hit teachers 



D. Swear or use dirty words 



[173] E Use illegal drugs 



[\u] F. Drink alcohol 



[175] G Copy homework 



[176] H Cheat on tests 



[177] I. Disturb class 



171] J. Smoke in school 



3 4 



3 4 



3 4 



3 4 



3 4 



3 4 



3 4 



3 4 



3 4 
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38. Please circle the number below to show how you feel 
about the following items. 



In your school, students: 
A. Cut class 



mevtr happens happens 

happens sometimes a lot 



(170] B. Cut school 



(1711 C Hit teachers 



D. Swear or use dirty words 



[173) E Use illegal drugs 



F. Drink alcohol 



J7S] G Copy homework 



(J76) K Cheat on tests 



177] I. Disturb class 



(1 



71] J. Smoke in school 



3 4 



3 4 5 



3 4 5 



3 4 



3 4 5 



3 4 



3 4 5 



3 4 5 



3 4 5 
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39. Please circle the number below to show how you feel 
about the following items. 



In this school, 

how many teachers: 

A. Tell students to try hard 
to do better on tests? 



nont c f th* half of the all of the 
teachers teachers teachers 



1 



tito] B. Tell students to try and 
get better grades than 
their classmates? 



till] 



C Do not care if students 
get bad grades? 



[1121 D. Tell students to do extra 
work so that they can get 
better grades? 



[183] E Make students work hard 
to get good grades? 



[114] F. Try to help students who do 
badly on iheir school work? 



[US] G Think learning is important 



(it6] R Allow students to choose 

what they want to work on? 



(i»7) I. Expect students to work out 
assignments on their own? 
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40. Please circle the number below to show how you feei 
about the following items. 



It is important 
that teachers: 



not important tort of very 

at all important important 



tiM) A. Help me do as well as 
I can on test . 



1 



( 19] B. leach me about right 
and wrong. 



2 3 



[190] C Show me how to get 

along with other people. 



[191] D. Discuss drug abuse. 



(192] E Teach me how to read 
and write well. 



[1931 F. Make school a pleasant 
place to be. 



2 3 



119*: G Discuss teenage pregnancy 



(195] K Discuss suicide 



(iwi 



I. Care about my fumre 
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[201] 



(202) 



(2031 



:04} 



(2061 
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41. Please circle the number below to show how you feel 
about the following items. 



In my school, 

ti97i A. There are unfriendly 
cliques (groups). 

[iMi B. Students help each other 

:i99i C Teachers give students 
extra help with their 
school work. 



strongly 
disigrtt disagree agree 



Dt Students try to help each 
other with school work. 

E Teachers seem to like 
the principal. 

F. Teachers seem to like 
each other. 

G Teachers seem to like the 
students. 

R Students here learn a lot more 
than students from 
other schools. 



(20S1 I. Students here are expected 
to do homework 4-5 times 
a week. 



J. Teachers care a lot more 
about their students than 
teachers from other schools. 



12071 K Most students feel very 
close to their teachers. 



2 
2 
2 



3 
3 
3 



strongly 
agree 

4 



YOU FINISHED. THANKS A LOT!!!!!!!! 



ERIC 



3ri 



t : s 4 i i 7 • 'I 10 u 



gfreflTtQKXRTQ PARA gSTOTTMITgS 
fflTODTQ gT.TM^ gflCQLAR 

Est0 cusstionario parts dm un astudio qua sa ha hacho para 
sabar c6ao an aianta aar astudianta da ascuala intarmadia. 

S CASILLA AL LADO DB LA COMTBSTACIOH COMBCTA O LLBHAHDO BL B8PA- 
CIO BM BLAHCO. ISHOBB LOS JTOMBaOS BBTBB C0RCHBTB8 A SU ISQUIERDA, 
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1. iEras hombra o mujcr? ( ) 1- hombra ( ) 2. mujer 



(13U14) 
dSUU] 



2. cQuA adad tianas? 



Tango 



aAos 



3. iA qu* raza/grupo *tnico parteneces? 

1. Asi&tico 

2. Nagro 

3. Bl2mco 

4. Hlspano 

5. Anaricano 

6. Otro; por favor aspaciflca . 



4. iCuintos aftos Hevas an asta ascuala? 



anos 



tm 5. ^En qud grado ast&s? 

( ) 1. Sexto grado 
( ) 2. Siptimo grado 
( ) 3. Octavo grado 



pn^nu»)6. Marca si an asta ascuala astis an algUn pro^raaa aapacial 

1. Mo 

2. Bi lingua 

3. Laboratorio Escolar 

4. Educacidn Eapacial - Salbn da Racursos 

5. Claaa da Educacidn Avanzada 

6. Capltulo I - Lactura 

7. Capltulo I - Matanitica 

8. Lactura con Objativo 

9 . Daportas 

10. Otro; por favor aspaciflca 
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7, iCr«es que es important* venir a la «scu*la? 



1251 



( ) 1. Si 
( ) 2. Nc 



lC6mo ll«gas a la ascuala la nayoria d« las v«c«s? 
(Marca UNO nolaaenta) 



( ) 1. Autobils ttscolar 

( ) 2. Tranvia / Tren 

( ) 3. Carro 

( ) 4. Caainando 



iWTOMi 9. Escoge las tr«s (3) raronss mis impcrtantss por las cuales 
vianss a la ascusla. 



1. Para aprander 

2. Para v«r nis aaistadas 
Para ir a la univarsidad 
Por participar an daportas 
Para obtanar trabajo an al future 
Por comar desayuno y alnuarro 

, . Por hacar algo 

8. Porqua ftis padras ma obliqan 

9. Porqua as major qua astar an casa 

10. Porqua me gusta algiin maestro/maestra 

11. Porque me gusta alguna clase 



3. 
4. 
5. 
6. 
7. 



l»l 10. En general, testis contento/a con tu vida? 

( ) 1. Si, mucho 

( ) 2. Si, algunas veces 

( ) 3. No, de ninguna manera 
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poi-rsn 11. icdmo usas la »ayor parts dml tiMpo que tianw d^spuAs de la 
11. J^^J^^^ (Escribi €1 nilB€ro dm horas an la linea al lado de 
cada actividad. Si no usas horas, sscribs 0.) 



1. Trabajo fusra ds la casa 

2. Hago tarsas dsl hogar 
" 3. Hago mis asignacionss 

' 4. Voy a un programa dsspuAs de clases 

' 5. Vso tslsvisibn / Vidsos 

6. Jusgos ds vidso 

7. Salgo con mis amistadss 

8. Lso 

9. Jusgo dsportss ^ . x 
■"lO. Cojo Isccionss (bails, mUsica, Isnguajs, etc.) 
*11. Oigo mUsica 

"l2» Sal JO a matar tismpo 

"l3. Otro; por favor sspscifica 



Pfl-W 12. cCbmo pasas la mayor parts de tu tismpo durants los fij^^ f« 
ismana? (Escribs si minsro ds horas sn la Imsa al lado ds 
cada actividad. Si no usas horas, sscribs 0.) 



1. Trabajo fusra ds la casa 

2. h-igo rarsas sn si hogar 

3. Hago asignacionss 

■4. Vso tslsvisibn / Vidsos 

5. Jusgo con ios vidsos 

6. Salgo a matar tismpo 

" 7. Voy a las tisndas / ds compras 

8. Voy al cins 

" 9. Voy a la iglssia, al tsmplo o al mszquita 

"10. Jusgo dsportss . 4. x 

^11. Cojo Isccionss (bails, mtlsica, lengua:js, etc) 

~12. Oigo mtisica 

"13. Otro; por favor sspscifica 
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iQa* hicist* la mayor parta dal tianpo duranta «1 varano 
pasado? (Marca tjra« (3) contastacionas) 



1. TrabajA f^ara da la casa 

2. AyudA an la casa 

3. Pul a aseuala da varano 

4. Ful al caapaaanto 

5. Hlca daportas 

6. Vlaj4 

7. Ma quadi an la casa 

8. Vlando talavisl6n / Videos 

9. Jugando con vldaos 

10. Matando al tiaapo 

11. otro; por favor aspecifica 



14a. iTianas trabajo fuera da la casa? 

( ) !• Si , \ 

( ) 2. No (Si no, por favor contintia con la pregunta #i5a) 

IMIJM] 14b. Si tu raspuasta as si, icuAntas horas trabajas? 
_horas/senanal 



15a. El afto pasado, ihiciste algiin trabajo voluntario? 
(ayudando a otros sin racibir pago) 

( ) Si ^ 

( ) 2. Mo (Si no, por favor continUa con la pregunta #16) 



(Ul 



15b. Si tu raspuasta as si, <'qu* hiciste? 



15c. Si tu raspuasta as si, ^cuinta:* veces lo hiciste? 

( ) 1. Saaarial 
( ) 2. Mansual 

( ) 3. Un n\ifflaro especifico de veces. ^cudntas? 
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16. 



Mis padr«« (o •ncargados) pi«n«an qu« la aacuelas as: 



( ) 1. Muy iaportanta 
( ) 2. laportanta 
( ) 3. Ho iaportanta 



l»tl • (TO 17 . ^Hal 



* visitado tus padras (o ancargados) la ascuala «ste afio? 



( ) 1. Si; ipor qu4? 

( ) 2. No; ipor qu4 no? 



18. iQu* languaja o languajas hablas an la casa? 



W-tro 19. Marca los tras (3) adultos mis iaportantas an tu vida. 



1. Madre 

2. Padra , 

3. Otro mianbro da familia; cq^ian? 

4. Un maastro/a 

5. Entranador 

6. Otro; iqui*n? 



twuioo] 20. 



jCuAlas son tus notas an la mayor parta da las dases? 



1. A 

2. B 

3. C 

4. D 

5. F 



ERIC 



3^G 



6 



tioi] • (losi 21. 



iCuAl GVM que •! trabajo d« un matro mn la ascuala? 
(Marca las tras (3) b^s inportanta«) 



) 1, Ayudarpo* a aprandar 

) 2. Sar nuas-tro a&igo/a 

) 3. Ensaftamoa lo buano y lo aalo 

) 4. Cuidarnoa 

) 5. Hactr qua noa p-Mrtanos M.an 

> f . Otro; por favor aspaciflca 



tio.i.tio*i 22. iCuAl cra«« qua as al trabajo d*l principal an tu ascuala? 
(Marca laa traa (3) ais iaportantas) 



Dirigir la ascuala 
Ayudar a los maastros 
Ayudar a loa «studiantas 
Disciplinary a los astudiantas 
3. Sar al jafa da los maastros 

6. Asagurarsa da la sagurJdad da los astudiantas 

7. Otro; por favor aspacifica 



1. 
2. 
3. 
4. 
5. 



tio7j . no»; 23. 



lOxAl craas qua as al trabajo da un astudiante en la escuela? 
(Marca las tras (3) aia; iaportantas) 



1. Racibix aducacibn 

7. Aprandar otras culturas 

3. Llavamos bian 

4. Hacar lo major quu puada 

5. Estudiar con ahlnco 

6. Ayudar a otros 

7. Ayudar a hacar dacisionas an la ascuala 

8. Otro; por favor arpecifica . 
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tno] 



24, Si ti«iM un probl^ma ••rio, ihay algiln adulto mn la Mcuiila 
al cual irias pidianc^o ayuda? (Marca una raspuasta solamante) 



1. Mo 

2* ItoMtro/a 
3. ConMjarc 
4« EnXarBara 

5. Diractor da Instruccidn 

6. Principal 

7. Entranador 

8. Otro; por favor aspacifica 



25. Las raglas da disciplina da la ascuala, ^son claras para tl? 



( ) 1. SI 



( ) 2. No 



tin] 



26. iTa suspandiaron an la ascuala al afto pasado? 



( ) 1. Si 



( ) 2. No 



liui • (lUl 27 . 



iQMi aspara asta ascuala qua tu hagas? (Marca tres (3) 



cosas) 



1. Qua astudia fuarta 

2. Qua mm llava bian con los otros 

3. Qua haga lo major qua puada 

4. Qua tanga buanas notas 

5. Qua ayuda a otros 

6. Qua ma porta bian 



28. 



iTa han castigado tus maastros duranta al \lltimo ano? 



( ) 1. Nunca 

( ) 2. Xlgunas vaces 

( ) 3. Muchas vacas 
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It") 29. iCdao la aayoria d« maMtros mn ««ta Mcu.la castiga a los 
•studianta*? (Marca UNA r««pua«ta solaaanta) 



1. Los da j an an la aacuala da«-^u*s da clasas 

2. DAndolas trabajo adicional 

3. Mand&ndolos a la oficina dal principal 

4. No los mandan a racrao ni al gianaaio 

5. Las habla an privado 

6. Las habla franta a todo al mundo 

7. Las grita 

8. Otro; por favor aspecifica 



mil 30a. Duranta al Ultimo afto, eta ba prasfaitado la escuela algrin 
praaie por h^car buan trabajo? 

( ) 2! No ( Si no, por favor contintla con la pregunta #31) 
1119]. (un 30b. Si tu raspuasta as si, ipor qu*? 



1. Trabajos acadtoicos 

2 . Daportas 

3. MUsica 

4. Arta 

5. Drama 

6. otro; por; favor aspecifica 



(mj-iujl31. Marca las cosas aspaciales que los maestros hacen Para los 
astudiantas cuando hacen algo bueno. (Marca todo 10 que 
aplica) 



( ) 1. Dan ragalos; baratos pero buenos 
( ) 2. Exhiben los trabajos an el sal6n 
( ) 3. Envlan cartas bonitas a nuestras cases 
( ) 4. Escriben buenos comentarios en los examenes y asig- 
naciones 

( ) 5. otro; por favor espacifica 
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tmi 32a. iT« ha pramiado tu maastro/a por hacar bian? 

( ) 2.* No (Si no, por favor continiia con la prac^inta #33) 
nai-t»301 32b. Si tu raspuasta as »1, ipor qua? 

( ) 1. Trabajo an la clasa 

( ) 2. Trabajo an la casa/asignaciones 

( ) 3. ExAoanas 

( ) 4. Buana conducta 

( > 5. Ayudar a otros 

( ) 6. otro; por favor aspaciflca 



iiJii-dJJi 33. ^Te gusta vanir a la ascuala? 



( ) 1. SI; ipor qui? 

( ) 2. No; cPor qui no? 



1134] •iiMi 34. sientas seguro an la escuela? 



( ) 1. Si; ipor qu*? 

( ) 2. No; ipor qu* no? 



lEstas haciendo muy buen trabajo! 



iContinual 
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3S. 



»or favor oircul* ml niiaoro mbmjo para iadioar cuAn impor- 
tanta aea loa aiguiaataa artieuloa. 



Vo Jilgo Kuy 

Zaportaata Zaportaata laportaata 



l\m A. Frj&llla 



B. Sar rico/a 



(1391 C. Amlatadaa 



luo] 0. Educaci6n futxira 



E. Div^rsidn 



F. Obtanar buanas notas 



G. Sentirsa Saguro/a (a salvo) 1 



I'^l H. Ayudar a otros 



I. Tanar trabajo ahora 



J. Trabajo futuro 
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3C. 



,or f.vor eircul. .1 aii«.ro Jb.jo par. indiear e6«o lo. 

miacm »uo«d« 8uc«d« 

imd* XlguBM Kuch«« ▼•c«s 



[It] 
ti«»l 

lisoi 
lisii 

(1321 
11S3J 

113*1 

lissi 

(1361 

11371 
(1311 

11391 
tl601 



LOS BstudiantMt 

A. Ayudan •!! la ascuela 

B. Ayudan a plan«ar activi- 
dadM ascolartts 

C. Cuidan la propi«dad de la 
•scuala 

D. S« ll«van bian 

E. Hacan aaistadas con «stu- 
diantas da otros grupos 
racialas/Atnicos 

F. Damuastran respeto por los 
ma as tr OS 

G. Ayudan a otros astudiantas 
a aprandar 

H. SB anvualvan an actividades 
ascolares y clubas 

I. Alagan a otros astudiantes 
por hacar buan trabajo 

J. Ayudan a hacar reglas an 
su clasa 

K. Dacoran salonas y pasillos 

L. Ayudan a otros astudiantas 
con problanas parsonales 

M. Hacan amistad con astudian- 
tas nuavos an la ascuela 

N. Ayudan a astudiantes qua no 
hablan Inglis a hablar con 
otros 



2 
2 



2 
2 



2 
2 

2 

2 



3 
3 

3 

3 



4 
4 



4 
4 



4 
4 



5 
5 



5 

5 

5 
5 



5 

5 

5 
5 

5 

5 



ERIC 



4^2 



12 



37. Por f*vor circul. •! Bto«ro «b*jo para iadicar c6.o t« 
aiMtM da loa aigulantaa articuloa. 



Huaea sucada sueada 

•ucada Jklgunaa Taeaa nuchas vaeas 



BB asta aseaala, loa aatudiaataat 



lui] A. Rob&n cosas 



B. Dastruyan propiadad da 
la as.cuala 



tiMi C. Escriban an las paradas 
da la ascuala 



(1«4] 



D. Hablan mal a otros astu- 
diantas 



E. Intiaidan a otros astu- 
UMl diantcs 



(iM] r. Palaan con otros astudi- 
antas 



G. Hacan comentarios raciales 1 



H. Se bur Ian da astudiantas 
con major as notas 
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. Por f«Tor eireul* •! n^m ■b«Jo par. indlear o6w) f 
ai«at«a da lea aiguiaataa artieolea. 

■usea fveada sueada 

giie«da ilgoaaa Taoaa Muebaa Taeas 



SB aata aaeuala^ lea aatudlmataat 

A. raltan a claaaa 
'""^ B. Faltan todo al dia '^a clasa 

C. La pagan a loa Maatroa 
^^""^ D. Blaafaaan o uaan inaultoa 
1173] E* drogaa ilagalaa 

F. Uaan babidaa alcohdlicaa 
(1731 <»• Copian aaignacionaa 
I,7«] H. Copian axtoanaa 
1177] I. Intarr\JBpan claaaa 
,,,„ J. Funan an la aacuala 
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39. Por favor circula •! fliia«o abajo para Indicar c6mo ta aian- 
taa an euaato a loa aiguiantaa artiouloa. 



Bn aata aaeuala, 

^euiatoa Baaatroa..*: 



viagvao 
da alloa 



La BltaA 
da alios 



Todos 
alios 



mw A. Dican a los aatudiantes que 
tratan da majorar an los 
axtoanas? 



(itoi B. Dican a los astudiantas qaa 
tratan da obtanar major nota 
(jua sus compaAaros? 



tun C. No las iaporta si los astu- 
diantas tianan malas notas? 



D. La dican a los astudiantas 
qua hagan trabajo adicional 
para obtanar majoras nctas? 



^,t)] E. Hacan que los astudiantas 
trnbajan fuerte para obte- 
ner buenas notas? 



nt4] F. Tratan da ayudar astudian- 
tas con su trabajo escolar? 



[U51 G. Craen que aprender es impor- 
tanta? 



(^t6i H. Penaiten a los estudiantes 
escoger en Ic que quieren 
trabajar? 



lit^l I. Esperan que los estudiantes 1 
hagan sus asignacionas solos? 
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40. Por f*vop eipcul* •! nii««po «b«jo pm indicar cu4n iapor- 
tmst* aoB loa aiguicntca artxouloa. 

i.p.s»t. i.p^t. 1-p.SLt. 

A. Me ainidsn a hacar lo major 1 2 3 4 5 

ntt] qus puado an ax^anas. 



1190) 



li»i) 



UM) 



IIH] 



B. Ma ansaftan sobra lo bueno 12 3 4 

y lo malo. 



C. Ma ansaAan a llavarme con 
otra ganta. 



D. Discutan sobra al atbuso 
da drogas. 



^^^^^ E. Ma ansaftan a leer y escribir 1 2 3 4 5 

bian. 



F. Hagan da la ascuala un 12 
lugar agradabla para estar. 



G. Discutan sobra el ambarazo 1 2 3 4 5 

da udolascantes . 



(^^1 H. Discutan sobra suicidio. 



I. Se intaresan an ai futuro* 
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41. Por fmvor circulm •! nUmmro atom jo para iadicar cuAa impor- 
tanta son lus siguiaatas artieuloa. 



ruartamaata Ho 

mn asto7 da 

dMacuardo aouardo 



tmi A. 
c. 

12001 D. 



mi ascuali^»« 

Hay grupos hostllas. 

Los astiidlantas sa 

ayudan unos a otros. 

Los aaastros provaan 
ayuda adlclonal para 
trabajo ascolar. 

Los astudlantas tratan 
da ayudarsa unos a o^os 
con al trabajo ascolzir. 



poll E. Los maastroa paracan 11a* 
varsa bian con al princi- 
pal. 

(2021 F. Los maastros paracan 11a- 
varsa bian unos con otros. 

(2031 G. Los maastros paracan lie- 
varsa bian con los estu- 
diantas. 

1204] H. Los astudiantas apranden 
mucho mis gua astudian- 
tas da otras ascualas. 

I20S1 I. Sa aspara qua los astu- 
diantas tangan asigna- 
cionas da 4 a 5 vacas 
a la samana. 

12041. J. Los maastros sa intara- 
san mis por los astu- 
diantas qua maastros da 
otras ascualas. 

1207] K. La mayoria da los astu- 
diantas sa siantan muy 
unidos a los maastros • 



1 
1 



2 
2 



Batoy 

da 
aouardo 



3 
3 



ruartamaata 
da 
aeuardo 



4 
4 



4 
4 
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MUCHAS GRACIAS !!!!!!!! 
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2 S 4 S « 7 I » 10 n 

CAU HOI TEAC NGEDIEM CEO MOC SINIHI 
cSnnghi cua hoc sinh 6 m6i tru6ng Trung-hoc Op M$t (Middk School). 

vTTt rnhir TP A Ltit NHIJNG CAV HOI Dl/Si DAY BA'nG CACH DANH DAU 
1% ^H0%GOAC ( ) GSN CAU m LOl DUNG BOACDIEN VAO CHO TRONG. 
Ii/NcIb' T?OfmVNGS0NHh TRO^G NGOAC VUdNG BtN TRAI. 



1. Namhoacnu? () 1. nam () 1 nil 

ti3i.il*] 2. Em bao nhieu tu6i? tuoi. 

(131.(161 3. Em thu6c chung toe nko ? 

( ) 1. A-ChSu 

( ) 2. Da-Den 

( ) 3. Da-Trang 

( ) 4. TSyBanNha 

( ) 5. NgiidiMyDadci 

( ) 6. Khdchon, n6ir5.^ 



(i7i.(m.(i9i 4 Em da hoc o tnibng n2iy diioc may nam roi ? nam. 

(Ml 5 . Em dang theo hoc lop may ? 
( ) 1. Ldp6 
( ) 2. L(Jp7 
( ) 3. Ldp8 

(211.(221.1231 6. Danh dau vJio nhifiig chubng triiih dac biet mk em dang theo hoc o tniong nSy 
( ) 1. Khongcd 
( ) 2. SongngU 
( ) 3. Lbpthinghi&n 
( ) 4. Gilo due dat biet 
( ) 5. Nhiing Idp cho hoc sinh khi 
( ) 6. Chubng 1 - TSp doc 
( ) 7. ChUdngl-Toin 
( ) 8. Tip doc 
( ) 9. Theduc.the'thao 

( ) 10.Khich6n, n6ir6__^ 



2 

t24i 7. Em c6 nghfrang di d6n tnibng li quan trpng lch6ng ? 

( ) 1. C6 
( ) 2. Khdng 

8. Em dfin tnittng btog phUbng tien n2io nhiSu nhai ? (chi dSnh diu vko rr0/ cho) 

( ) 1. Xe bus cua tnibng 
( ) 2. Xe bus, xe difin ngam 
( ) 3. Xehbi 
( ) 4. Dibo. 

[26i.r27UMi 9. Diiih <^\i wko 3 ly do quan trong nMt Tai sao em den tmbng ? 

( ) 1. Dhhqc 

( ) 2. DcgSpbanbi 

( ) 3. De' diibc vko Dai hoc 

( ) 4. diioc chbi th£ thao 

( ) 5. iDfi diibc vific littn trong tUong lai 

( ) 6. De dubc an sing ah tnia 

( ) 7. D61knbatcuchuy6ngi 

( ) 8. Boi vi cha me dp bupc 

( ) 9. Bbi vF tnibng hoc tbthbnbnhi 

( ) 10. Bdiviemthichthiy/cbniodb 

( ) ll.Boivjemthi'chlbphocnJloZlb 

129) 10. N6i chung, em c6 sung silbng vS dbi sbng cua em khong ? 

( ) 1. C6, ra'tnhigu 

( ) 2. C6, thinh tho'ang 

( ) 3. Khdng, khbng mbt ti nao ca. 

ERIC ^' 
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Doi-issi EmdS diing thoi gi6 cua em nha the nio sau khi tan hoc ? (Viet so gio vac cho 

trong gaii m6i l^mh d5ng. Neu kh6ng c6, viet 0) 

1. Limvi$csaugi6hoc 

2. Taphit , 

3. Utobkivo 

4. Chiibng tiinh hoc them 

5. Xem ti-vi/phim 

6. Choi videja games 

7. -Di chOi voi ban 

8. Dpcsich 

9. Chditbe'thao 

10. Hoc kheu vu, nghe thuai, am nhac, ngon ngu...v.v.. 

ll.QidiSmnhac 

12.-Dich6i 

13. Khdc hbn, n6i ro 

156] -110] 12. Em da dung^thoi giocuaem nhiithe'naov^ongay cuoituSn ? (Vi6t so gio vao 
cho trong gSh moi hkih fldng. Neu khong c6, viet 0) 

1. Lilm vific sau gib hoc 

2. Taphittainhi 

3. Umbiivt) 

4. Xem ti-vi/phim 

5. Chbi video games 

6. Dichbi ^ 

7. Di dcQ nhting trung tSm buon ban, mall/shopping 

8. Dixemxi^ne 

9. Di nhi th6, chua, hoSc dam tang 

10. Chbi the thao 

1 1 . Hbc kheu vu, nghe thuat, am nhac, ngon ngd...v.v.. 

12. ChbiSmnh^c 

13. Khdc hbn, nbi r5 . 
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till . tiJi 13. Em aa dung thoi gi6 cua em nhii th5 nko trong mua hi qua ? (diiih diu 3 cho) 

( ) 1. LSm vi|c sau gio hoc 

( ) 2. Giupdovl'chuy^nnhi 

( ) 3. ©ihochfc 

( ) 4. -Ditraihi 

( ) 5. Choitbe'thao 

( ) 6. Didulich 

( ) 7. 5nM 

( ) 8. Xem ti-vi/phim 

( ) 9. Choi video games 

( ) 10. Di Choi 

( ) ll.Khichdn, nciro 

14a. Em c6 vieclkn khong? 
( ) 1. C6 

( ) 2. Khong (neu khong. tiep tuc o cau hoi 15a) 

It3].ti6] 14b. Ncu c6, em lam bao nhicu gio m6i tuan? gio/tuan 

1 5a. Trong nam qua, em c6 Hun nhung viec tinh nguycn nao khong ? 
( ) 1. C6 . ' . 

( ) 2. Khong (niu khong. tiep tuc d cau hoi 16 ) 

i«« 1 5b. Ncu c6, em da lim gi? . 

15c. Neu c6, cm da Uun bao nhieu lin? 
( ) 1. HahgtuSh 
( ) 2. Hahg^g 

( ) 3. Motsoiah. baonhieu? 
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tM) \ 5, Cha me tja nghi ri^g tniong hqc Ik: 

( ) 1. R&tquantTQng 

( ) 2. quantrong 

( ) 3. Khdng quan trong 

[91] - t*Ji ^ ^ Cha me em c6 thtoi tniong trong nam hpc nky kh6ng? 



(9*1.1931 
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( ) 1. C6. lydo? 

( ) 2. Kh6ng, lydo? 



18. Em dung nhung thii tieng nio de n6i chuy fin d nha? 



r9«] • t9«] 1 9. Dinh dau vio 3 ngu6i Ion aioi quan trpng nhat trong doi em? 

( ) 1. Me 

( ) 2. Cha 

( ) 3. Eicon; ai? 

( ) 4. Thay/cogido 

( ) 5. ThaVday theduc 

( ) 6. KMchon; ai? 



(9'. ..iioo] 20. Hang diem nao ma em thiiong dat diipc trong cic lop em hoc? 



( ) 1. A's 

( ) 2. B's 

( ) 3. Cs 

( ) 4. D's 

( ) 5. Fs 
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(lOll-tlOS] 21. 



Hieo em nghH nhi&n vu cua thSy c6 gjdo trong trtbng li gi? 
(khdng (fiioc dinh diu nhieu hdn 3 ch6) 
) 1. Giupddc|cemboctip 
) 2. Ikn b^m vdi cdcjtm _ ^ , 
) 3. Day cdc em nhung dieu hay le phai 
) 4. Sahs6cdlcem 

) 5. KMch6n;n6ir5 - 



nw] . (106] 22. Theo em nghi, nhiem^ vu ciia thiy Hifiu tniong trong tnibng la gi? 
(khdng dtioc dSmh dau nhioi hon 3 cho) 
) 1. DiSukhieh tniong hoc 
) 2. Giupdqthay/c6gido 
) 3. Giup do hoc sinh 
) 4. Trimg phat hoc sinh 
) 5. Limchu dlcthayco 
) 6. Bao dam hoc sinh diibc an to^ 
) 7. Khdc hbn; n6i ro 



1107] . (109] 23. 



Theo em nghi, nhiem vu aia ngu6i hoc sinh trong tnibng hoc nay la gi? 
(khdng diioc dMi dau nhieu hon 3 cho) 
) 1. Dubc su gido due 
) 2. Hoc hoi ve the gidi 
) 3. Lim quen voi hoc sinh khdc 
) 4. De 1^ theo siic minh 
) 5. Dc hoc tSp Cham chi 
) 6. D6'giup hoc sinh khic 
) 4. Phu giup de to quyetdinh trong tnibng 

) 5. Khichon; nbirb . 
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(1 101 24. Neu em c6 mdt tro n^ai trSm trpng, em se hoi ai de can sij giup do? 
Gchdng duoc dloh diu nhieu hdn 3 chb) 
( ) 1. Khdngc6ai 
( ) 2. ThSycogido 
( ) 3. Thiy c6 hiibng dSn 
( ) 4. Ytii. 

( ) 5. Ngiioi chi dao tnibn hoc 
( ) 6. Hieutrucng^ 
( ) 7. ThSydaythe'duc 

( ) 8. Khic hon; n6i r6 



inn 25. Em c6 thong hieu nhuing le loi ve ky Mt ciia miong nliy khdng? 
( ) 1. C6 ( ) 2. Khong 

(1121 26. Trong nam hoc qua, em c6 bi dudi hoc hay khong ? 
( ) 1. C6 ( ) 1 Khdng 

(1131 • (iis'i 27. Tmbng mong mudn cic em lim gf? (ddnh daii 3 chd) 

( ) 1. Hqc tip Cham chi' 

( ) 2. liim quen vdi hoc sinh khic 

( ) 3. liun theo kha nimg ciia em 

( ) 4. Du6cdi6mtdt 

( ) 5. Giup dd n^di khic 

( ) 6. Ngoanngoan 

(1 16] 28. Trong n^m hoc qua, em c6 bi tning phat boi thay/cd giio khdng ? 
( ) 1. Khdng bap gib 
( ) 2. Thinhthoang 
( ) 3. NhieulSn 
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29. HSu het cdc thSy giio trong tni6ng nJly tning phat hoc sinh bang cdch nao? 
(dinh diu chi 1 ch6) 

( ) 1. GiU hoc sinh laitnidngsaukhi tan hQc 

( ) 2. C^o hoc sinh limi di£m ^ 

( ) 3. Gili hoc sinh deh van ph6ng HiSu tnidng _ , 

( ) 4. Khdng cho hop sinh ra Choi trong gi6 Choi gib the due 

( ) 5. N6ichuy6nv<JicdnhSn hoc sinh 

( ) 6. N6i vbi hoc sinh tnibc ca l6p 

( ) 7. La hit hoc sinh 

( ) 8. Kh^c hon; n6i r5 ^ 

iiiii 30a. Trong nam hoc qua, em c6 diioc tniong ban thuong gi khong ? 
( ) 1. C6 , 

( ) 2. Kh6ng (neukhdng.tieptuc ocauhbi31) 

1119] . n2i] 30b. Neu c6, em da duoc loai khen thUong vS chuyen gi? 

( ) 1. HoctSp 

( ) 2. Thethao 

( ) 3. Amnhac 

( ) 4. NghSthuat 

( ) 5. Kich 

( ) 6. Khic hon; n6i rd - 

• iiM] 31. Thay CO gido trong tniong em^c6 lim gf d^t biei cho hoc sinh khi hoc -inh dat 
duoc xua't sic khong ? ^dinh dau nhiing phah c6 lien quan) 
( ) 1. Oio nhiing phSn thubng nho nhilng thii vi 

( ) 2. Treo bii 1^ cUa em trong lop 

( ) 3. Gui. thil khen ve^nh^ 

( ) 4. VietnhimglbiphekhuyenkhichtrenbJdthiv^bkilkn 

( ) 5. Khdchon;n6ir5 
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U271 32a. Em c6 bao gi6 diibc thiy c6 giio khen thilong xuat sic khong? 
( ) 1. C6 

( ) 2. Khong (neu khong, tiep mc 6 cau hoi 33) 

1121] . (1301 32b. Neu c6, dlipc khen diabng v£ van degi? 

( ) l.Bki tobtnibng 

( ) 2. B2d lam d nhi 

( ) 3.Baithi 

( ) 4. Ngoanngoan 

( ) 5. Giup do ngiidi khic 

( ) 6. Khichon; ndiro^ 



;i3i] . 1133) 33. Em thich 'li deia tnidng khong ? 
( ) 1. C6; taisao?. 



( ) 2. Khong; tai sao?. 



(13*1 H361 34. Em c6 cam thSy an toin o tnibng khong ? 
( ) 1. C6; tai sao? 



( ) 2. Khong; tai sao? 
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tI37] 
[131] 

t»391 
l\*0] 

11*21 
IU31 
114*1 
(US] 
IU61 



35 . H2y khoanh trdn nhimg s6 du6i de' chi muc do quan trong cua nhung de muc duoi 
day doi v6i em. 



Khong hoi lit 
quan trong quan trong quan trong 



A. Gia dinh 

B. Diioc giku sang 

C. Banbi 

D. Sii giio due trong tiibng lai 

E. Cdsuvuichbi 

F. DU6c diem tot (cao) 

G. Cam thay an tokn 
R Giup do ngiidi khic 
I. C6 diibc viec tot 

J. Vi$c Uun trong tubng lai 



2 
2 
2 
2 
2 
2 
2 
2 
2 
2 



3 
3 
3 
3 
3 
3 
3 
3 
3 
3 



4 
4 
4 
4 
4 
4 
4 
4 
4 
4 



5 
5 
5 
5 
5 
5 
5 
5 
5 
5 
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36. HSy UK-nh Ii6n nhig s6 <hidi as chS mic 46 quan trpng ala nhtog 44 muc du6i 
diy doi v6i cm. 



Kh^'oiDgid Tljnhthottig Huiongxuyen 

xiyn x»y» «y» 



Hoe sink: 
1147] Giiip d6 Ifin nhau trong tnidng 

t«*«i B . Phu vach k6 hoach sinh boat cua tnibng 

i\*9] C. Chin s6c tki sin oia tnibng 

nsoj D. H6anh5vdi hoc sinh khic 

iiMi E. Um ban vii nhiing hoc sinh thuoc 
Chung i$c khic 

IIS21 F. Kinh trong thly c6 giio 



IIS3) 
IISS) 



G. GWp A6 bpc sinh khdc hoc hoi 

R Tham gia vko bOi dokn sinh boat 
trong tnibng 

1 . Chuc tung nhiin^ hoc sinh khi c ho 
dat dil6c xuit s&c 



(IS6] J. Giupl^kylu&t trong Idp 



s'l K. Tiang tri' pb5ng hoc vi 16i fli trong tniSng 
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I is»i L. Giup ff6 bpc sinh kh4c vbi ntaing vSn 
deciobfla 

IIS9J M. Lim ban voi nhitag bpc sinh m^i 

n«o) N. Giiip ddnhiing boc,sinh chiia bie't tifi'ng Anh 
n6i chuyen voi nhUng bQC sinh khic 

4fS 



2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 
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37. H§y khoanh tr6n nhitog so'dubi flS miic d6 quan trong ciia nhmif, flSmuc du6i 
day d5i v6i em. 



Tvong tnidng hoe niy, hoc sinh: 

(uii A. Tr6m cap dd'vat cua ngu5i kMc 

n«j] B. PhS hiiy san cua nhk tnibng 

116J1 C. Vict nham (viei len tildng) 

(!«*] D. D& man va bit lich su voi hoc sinh khic 

ii«3] E . N6i nhimg dieu tin dc voi hoc sinh khic 

F. Bat nat hoc sinh khic 

u «7] G . Danh Ipn v6i nhiing hoc sinh khic 

»"] H. Phe binh ky thi chung t6c 



KhdogfaaDgib TldahtboaDg Tlulongxuye'' 
»y Tt xay ra xay ra 



2 3 4 5 



2 3 4 5 



2 3 4 5 



2 3 4 5 



I. Choc gheo nhiing hoc sinh dupe diem cao 1 2 3 4 5 
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38. Hay khoanh trtm nhiiiig s6 dU6i dfi'cM miic dO quan tn?ng cua nhitag dfi muc duOi 
diy d6i vdi em. 



Trong truong hoe ndy, hoe sinh: 
1169] A. Bo lop 

/ 

11701 B. Tr6n hoc 

11711 C. Dinh thSy c6 giio 

inai D. Chui thfe hoac chui tuc 

11731 E. Dung si ke, ma my, din sa , v.v.. 

1174) Uo'ng ruou/beer 

H7S1 G. Ch^p lai bai Ikn tii ngiioi khic 

11741 H. Gian ISn rrong bai thi 
1177] X. Phi roi lop hoc 



Khfiogbaogib TUnhtfaoeng Thtlcng xuyen 
xay n xay ra xay ra 



!i7i] J. Hut thufic trong tniSng hoc 



2 3 4 5 



2 3 4 5 



2 3 4 5 



2^45 



2 3 4 5 



2 3 4 5 



2 3 4 5 
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39. Hay khoanh tr6n nhiiig s6' diibi dS chi muc dO quan trpng cua nhung d6 muc du6i 
diy ddi v6i em. 



Trong trUdng hoe nty, c6 boo nhiiu 
thiy c6 gido: 

ti7»i A. Khuyen bao hoc sinh c6 gang de 
Iknbkithitd'thdn? 



Kh6ngin5t Nuasd' Tarca 
thiy c6 nto thiy c6 th?y c6 



titoi B. Khuyen bao hoc sinh cd gSng de dat 
dU6c diem t6't hdn hoc sinh cung I6p ? 

nil] C. Kh6ng lo l^g khi hoc sinh diioc 
diemxiu? 

ni2] D. Khuyen bao hoc sinh llim them bki lilm 
de hoc sinh c6 the dat diidc diem tot hon ? 

t>"i E. Lkn hoc sinh cd'gang de' dat ddbc 
diem t6t ? 

iit4] Giup do nhiing hpc sinh k6m ? 



G. Nghi ring hoc hoi li quan trong 



(1 t«i H. Cho ph^p hpc sinh l\ia chpn dieii mi 
hpc sinh mu6n lim ? 

u 17] I. Mong mu6n hpc sinh tJ minh lim 
bkiv(S? 



2 
2 
2 
2 
2 



3 
3 
3 
3 
3 



4 5 
4 5 



4 5 
4 5 



2 3 4 
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40. H5y khoanh trbn nhving sd'dddi 35 chi miic 36 quan trc?ng cua ohiing ■36 muc du6i 
3ay ddi v6i em. 



Su quart trong vi thay c6 gido: 

A. Giup 3o em Uto bki thi voi kha 
nang aiaem 

tJ Ml B . Day em nhiing dieu dung sai. 

i\99] C. Chi chocm bict c4ch h6a ihuan 
v6i ngiici khdc. 

n»u D. Bin thao v| sil te hai cua xi-ke, 
ma-tuy, dm -sa, v. v.. 

um E. Day em cich doc vi viet gioi. 

119J1 F. Lim cho tnibng hoc tro thinh mot 
ndi thoai mii va d£ chiu. 

nw] G. Bin thao vSvSn de'c6 thai cua 
thieu nien. 

[\9S] H. Bin thao vg'van de'^tii vSn. 



HMi I. Lo lahg ve tiiong lai ciia em. 



Khdng hoi iSt 
quan trong quan trpng quan trong 



2 3 4 5 
2 3 4 5 



2 3 4 5 
2 3 4 5 



2 3 
2 3 
2 3 



4 5 
4 5 
4 5 
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41 . H2y khoanh trdn nhiiig s6'du6i dS chi mii'c dd quan trong cua nhiing de muc duoi 
diy ddi v6i em. 



rStkhong khong rat 
dfiogy dfingy dohgy dongy 



Trongjrudng cua em: , 
n*7] A. Cd nhiing hQcsinhmSt cam tkih 1 



(iMi B. Hoc sinh giup do 1^ nhau 



iiM] C. Thay c6 giiio giuB do them hoc sinh 
v6 1^ 6 tniong. 



12001 D. Hoc sinh giupdbiaanhauvfibSi 1 
lam b tniong. 

12011 E. TMycogiiocbvethichthay/co 1 
Hieu tniong. 

""^ F. Thay CO giio cove diichlahnhau 1 

G. Thay cdgiioc6vethichhocsinL 1 

R Hoc sinh hoc hoi nhieuhonnhiuiig 1 
hoc sinh tu tnidng khic. 

^^"^ I. Hocsmhptmlknb^dnhilkhauig 1 
4-5 ISn moi tuSh. 

J. Th§y cd giio k) lang v£ hoc anh 1 
nhieu hbn Ik ±£y c6 cua tnidng khic 

K. Hiuh£t hoc sinh cam thIytfaSn 1 
thiet vbi thfiy c6 giio. 



CAM ON CflC EM !!!! 
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Boston University— Boston Public Schools Collaborative Project on 
RESEARCH FOR EFFECTIVE MIDDLE SCHOOLS 
Mary H. Shann. Project Director 

STUDENT QUESTIONNAIRE - ALL FOUR SCHOOLS 
Number of Respondents * 1583; Surveyed March. 1989 



1 . Are you male or female ? (53.3«^) male (45.5%) female (1^^) missing 

2. Average age- 12.9 yt ars. Missing (2.4%) 

3. What race/ethnic group(s) do you belong to? 



12.8% 


Asian 


32.6% 


Black 


8.9«/o 


Caucasian (white 


36.2«/o 


Hispanic 


1.7«/o 


Nativ* American 


3.3•^ 


Other 


2.5% 


Combination 


2.Vh> 


Missing 



4. Average number Of years at this school- 1.9 years. Missing (6.6%) 

5. What grade are you in? 

38.9% Sixth grade 

31.4% Seventh grade 

29.4% Eighth grade 

3Pk Missing 

6. Check if you are in any special program in this school? 



22.5% 


No 


11.6% 


Bilingual 


2^% 


Lsb Class/Clustar 


5.80/0 


Special Education - Resource Room 


8.7«yo 


Advanced Work Class 


13.5% 


Chapter 1 - Reading 


33% 


Chapter 1 - Math 


£% 


Targeted Reading 


3.0*^ 


Sports 


5.7% 


Other 


16.2% 


Combination 


4.7% 


Missing 



7. Do you think H b important to come to school? 

96.4% Yes 3.5% No 0.1% Missing 

8 . How do you get to school on most days? 

40.4% School bus 

16.6% TheT 

12.1% Car 

30.9% Wak 

5% Missing . 
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9 . CheKJk the 3 most important reasons why you come to school. 



1st Toleam (93.4%) 

To see my friends (20.4%) 

3rd To get Into college (70.5%) 
To participate In sports (7.9"/o) 

2nd To get a Job In the future (73.6%) 
To get brealcfast and lunch {^sy/o) 
For something to do (4.0^^) 
Because my parents make me (9.8%) 



1 0. In general, are you happy about your life? 



53.8% Yes, v«ry much 
43.1% Yes, sometimes 

3.1% No, not at ail 

1.3% Missing 

1 1 . How do you spend most of your time after school? (Percentages not includino missing data) 
Activity Hours 



Afterschool program 
Watch TV/videos 
Play video games 
Go out with my friends 
Read 



0 


1 


2 


3 


82.i<yo 


05.2% 


03.6% 


03.2% 


28.6% 


48.4% 


14.8% 


04.3% 


6.T>k 


50.4% 


26.3% 


09.6% 


77.2% 


13.2% 


04.7% 


02.5% 


10.1% 


19.5% 


21.9% 


18.0% 


43.8% 


28.7% 


12.2% 


06.3% 


30.5% 


17.5% 


15.0% 


12.6% 


33.5% 


44.2% 


13.6% 


03.4% 


40.0% 


21.6% 


15.2% 


11.5% 


86.5% 


05.4% 


03.2% 


02.1% 


54.5% 


iO.2% 


09.8% 


06.6% 


45.5% 


14.9% 


11.4% 


07.6% 


■9.1% 


06.8% 


04.3% 


03.2% 



Work outside the home 82.1% 05.2% 03.6% 03.2% 05.9% 

Do chores 28.6% 48.4% 14.8% 04.3% 04.0"/^ 

Do homework 6.7•^ 50.4% 26.3% 09.6% OT.1% 

30".4% 
08.9«/o 
24.6% 
05.4% 

Ray sports 40.0% 21.6% ii.a-«> 117°/o 

x-iT-TL.^^. flf?.«iOA. Qe^o/„ 03.2% 02.1% 02.70/0 



Take lessons 
Play music 
Hang out 
Other 

12. How do you spend most of your time on weekends? (Percentages not including missing data) 
Activity Hours 



:3.7% 
20.80/0 
06.9% 



4+ 



v/ork outside ofthe home 82.2% 04.6% 03.8% 02.7% 06.5»/< 

Dochor^wthome 33.7% 33.7% 19.5% 06.5% 06.6% 

Do homework 47.8% 32.1% 11.3% 04.8% M.9 A 

Watch TVMdeos 12.2% 14.6% 17.8% 15.4% 40.2;a, 

nay vktoo games 41.5% 21.6% 14.9% 08.7% 13.yA. 

Hangout 36.5% 10.7% 10.3% 11.0% 31.8»^ 

Go to the mall/shopping 22.8% 11.2% 17.2% 17.7% 31.?A. 

Go to the movies 32.2% 05.0% 26.7% 17.7% 8.4% 

Gochurch.temple.mosqje 53.5% 17.5% 11.0% 07.0% 1.0% 

Ray sports 41.0% 17.6% 15.4% i;i.1% 13.9% 

Take lessons 88.9% 03.8% 03.5% 01.3% 02.4% 

Ray music 55.9% 15.2% 11.2% 05.2% 12.5% 

Other 78.5% 03.6% 03.3% 03.3% 11.2% 



0 
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1 3. How did you sptnd most of your time lut summer? Check 3 wtys. 

1st - Travel 2nd - Play sports 3rd • Hang out 
14a. Do you have a job outside the home? 

20.6% Yes 74.5% No 5.0% Missing 

14b. If yes, how many hours do you work per weeic? Average - 62 hours. 

I5a. In the last year, have you done any volunteer work? 

26.5% Yes 
73.5% No 
6.9% Missing 

15c. If ves. how many times did you do ft? 

51.5% Wee' V 
11.9% Monthly 
36.6% A specific number of times 

(76.8% did not do volunteer work, or did not answer) 

1 6. My parents (or guardian?) think that school is: 

92.8% Very important 
6.7^/0 importartt 
3^/o Not important 
2^k Missing 

1 7. Have your parents (or guardians) visited the school this year? 

60.4% Yes 
34.5% No 
5^/o Missing 

1 9. Check th'^ 3 most important adults in your life 

1st Mother (97.0<^^) 
2nd Father ((83.5%) 
3rd Other relative (55.6%) 

A teacher (14.6%) 

A coach (2.8%) 

Other (15.2%) 

20. What are most of your grades like in your classes? (T wo responses keyed) 



A's 


32.8% 






B's 


35.3% 


•♦• 


22.7% 


C's 


20.9% 


•♦• 


12.3% 


D's 


4.0% 


•♦• 


3.4% 


F's 


22•^ 


•♦• 


J9% 



2 1 . What do you think tht tiacher's job is in this school. Chack tht 3 ri>DSt Important things. 



1st Toh«lpusltam (98.1%) 

TotMourfriand (412%) 
2nd To tMCh us right from wrong (77.4%) 

To taka cars of us (10.7%) 

To maka us bahava (40.9^/b) 

Othar (11.2%) 

22. What do you think tha principaPs job is In this school? Chack tha 3 most important things. 

1st To run tha school 

2nd To maka sura that studants ara safa 

3rd To halp tha studants 

2?. What do you think tha students job is In this school? Chack tha 3 rnost Important things. 

1st To gat an education 
2nd To study hard 
3rd To do my bast 

24 If you had a serious personal problem, is there any adult in this school you would go to for help? Check 



answer only. 




37.7>/o 


No 


28.7yo 


Teacher 


15.2% 


Guidance Counsellor 


4.6^/0 


Nurse 


LWo 


Director of Instnjction 


7.yAi 


Principal 


1.1% 


Coach 


4.4% 


Other 


Z3Hf^ 


Missing 



25. Are the rules of discipline of this school clear to you? 

86.7>/o Yes 12.3% No 1.0«^ Missing 

26. In the last year, have you been suspended? 

1 3.3% Yes 85.5% No 1 .4% Missing 

27. What does this school expect you to do? Check 3 things. 

1st To study hard (84.2%) 

To get along with others (37.3%) 
3rd To do my bast (S5.8<^/o) 
2nd To gat good grades (70.1%) 
To halp others (7.7%) 
To behave (36.5%) 

28. In the last year, have you been punished by your teachers? 

48.2«A> Never 

44.0^0 Sometimes 

5.8% A lot 

1.9^/o Missing 
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29. How do most teachers in this school punish students? 

T7Xfik Keep students after school/class 
1 .5<yo Give students e)Ctra work 
7.4% Send students to the principal's office 

SPio Keep students from recess and gym 
Z,Tk Talk to atudants privately 

SFk Talk to ^dents in front of everyone 
4.7^/0 Yell at students 
a4% Other 

1.6^/o Missing 

30a. In the last year, has the school presented you wrth anything for doing well? 

44.1% Yes 52.1% No 3.8^/o Missing 
30b. If Yes. what was It for? 

1st Academics 

2nd Other (perfect attendance, computer work) 
3rd Sports 
4th Art 
5th Music 
6th Drama 

3 1 . Check the special things teachers do for snjdents when they do well. Check all that apply. 

1 St Write nice comments on tests and homework 
2nd Put up my work in the room 
3rd Give out small but fun prizes 
4th Send nice letters home 
5th Other 

32a. Have you been rewarded by your teacher for doing well? Missing-€1 

SS.yk Yes 41.0^/0 No 3.8% Missing 
32b. If yes, what was It for? 



1st 
2nd 
3rd 
4th tie 
4th tie 
6th 



Classwork 
Good conduct 
Tests 
Homework 
Helping out 
Other 



33. Do you li\e to come to school? 

78.9% Yes 16.9% No 

34. Do you feel safe at school? 

69.1% Yes 25.2% No 



4.2% Missir^g 



5.8% Missing 
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35. Please circle the number below to show how important the following Hems are to you. 





not 




aoftof 




very 




Important 




important 




important 


Itsm 


1 


2 


3 


4 


5 


A. Family 


.4% 


.4% 


2.7% 




92.1% 


B. Being rich 


24.5% 


11.4% 


35.2% 


10.6% 


18.2% 


C. Friands 


3.6% 


4.9% 


26.8% 


22.4% 


42.2% 


D. Future education 


fl«/* 


1.6% 


5.3«/o 


a.8«/o 


83.4% 


E. leaving fun 


8.4% 


9.9'k 


33.1% 


21.2% 


27.4% 


F. Getting good grades 


.TVo 


JB% 


5.1% 


14.9% 


78.7% 


G. Feeling safe 


1.7% 


2J% 


9.1% 


18.5% 


58.4% 


H. Helping others 


3J?'/. 


6.2% 


27.4% 


28.4% 


34.7% 


1. Having a job now 


12.8% 


8.9% 


24.5% 


17.5% 


36.3% 


J. Future job 


1.1% 




5.1% 


9.7»/o 


83.4% 



36. Please circle the number below to show how students act in your school. 
Item 
missing 
Students: 

A. Help out at school 

B. Help plan school activities 

C. Take care of achool property 

D. Get along wKh each other 

E. Make fdenda wtth students of 

other racial/ethnic groups 

F. Show respect for teachers 

G. Help other students learn 

H. Get into school activMea and 

I. Compliment other students for 

good work 
J. Help make daaa niles 
K. Deoorale daaarooms and hails 
L Help other students with personal 

problems 
M. Make IHenda with students who 

are new to the school 
N. Help students who dont speak 

English talk to others 



never 
happens 




happens 
sometimes 




happens 
alot 


1 


2 


3 


4 


5 


11.4% 

22.7% 

30.1% 

6.6% 

6.3% 


10.6% 
15.0% 
16.6% 
10.4% 
72% 


53.8% 
34.2% 
27.9% 
36.4% 
27.8% 


11.6% 
16.1% 
10.3% 
22.1% 
20.8% 


12.6% 
12.0% 
15.1% 
24.5% 
38.0% 


10.1% 
15.2% 
18.4% 
20.1% 


12.0% 
15.7% 
11.7% 
15.0% 


33.6% 
34.4% 
29.5% 
30.5% 


16.6% 
17.6% 
19.1% 
17.0% 


27.7% 
17.0% 
21.3% 
17.4% 


41.1% 
15.5% 
26.0% 


17.7% 
13.6% 
16.4% 


20.6% 
31.3% 
27.9% 


9.7% 
17.8% 
14.0% 


11.0% 
21.9% 
15.8% 


4.7% 


7.8% 


30.6% 


22.7% 


34.2% 


21.3% 


11.7% 


27.4% 


14.8% 


24.8% 
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37. Ptease circit th^ numbar below to show how you 1—\ tbout the following Hems. 






Item 


never 




happens 




happens 
alot 


happens 




sometimes 






1 


2 


3 




5 


In this school, students: 












A. Steal things from others 


31.7% 


12.9% 


28.7% 


06.4% 


20.3% 


B. Destroy school property 


27.7% 


11.2% 


24.5% 


10.4% 


26.3% 


C. Write greffK (write on wails) 


26.2% 


10.3% 


18.4% 


10.3% 


34.9% 


D. Bad-mouth other students 


13.9% 


08.2% 


19.0% 


12.9% 


46.1% 


E. Bully other students 


20.9% 


10.2% 


21.2% 


15.1% 


32.6% 


P. Fight with other students 


14.0% 


10.0% 


23.1% 


14.4% 


38.ff>/o 


G. Mat<e racial insults 


24.2% 


11.7% 


23.0% 


13.1% 


27.9»/o 


H. Tease students who get good 


31.2% 


10.7% 


19.9% 


13.2% 


25.0% 



grades 



38. In your school, studsnts: 



A. Outclass 


29.4% 


12.0% 


27.4% 


07.8% 


213% 


B. Cut school 


32.3% 


13.0% 


24.5% 


10.1% 


20.1% 


C. Hit teachers 


60.8% 


13.8% 


14.5% 


04.8% 


06.1% 


□.Swear or use dirty words 


17.4% 


09.5% 


17.9% 


09.4% 


45.7% 


E. Use illegal drugs 


66.0% 


11.4% 


13.0% 


03.5% 


06.1% 


F. Drink alcohol 


66.1% 


11.3% 


12.0% 


04.4% 


06.2% 


G. Copy homeworit 


16.8% 


12.1% 


21.9% 


12.0% 


37.2% 


H. Cheat on tests 


31.3% 


12.9% 


20.9% 


09.8% 


25.0% 


1. DiTH'Tb class 


18.9% 


10.6% 


20.8% 


14.0% 


35.7% 


J. Smoke in school 


60.3% 


09.8% 


12.8% 


04.7% 


12.4% 
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39. Please circle the number below to show how you feel about the following Items. 

It^^ none of the half of the all of the 

teachers teachers teachers 





1 


2 


3 


4 


5 


In this school, how many teachers: 












A. Tell students to try hard to do better on tests? 


02.9% 


03.8% 


22.6% 


12.8% 


57.9% 


B. Tell students to try & get better grades than 


28.5% 


11.1% 


21.6% 


12.0% 


26.8% 


uieir wAssMiMiiod 1 
C. Do not cars if students get bad grades? 


53.0% 


13.5% 


18.4% 


05.4% 


09.7% 


D. Tell students to do extra work so that they can 


06.9% 


08.0% 


26.5% 


17.7% 


41.0% 


get better grades? 
E. Make students work hard to get good grades? 


05.7% 


08.3% 


20.6% 


19.4% 


46.0% 


F. Try to help students who do badly on their 


08.6% 


06.4% 


17.9% 


19.7% 


47.4% 


school work? 
G. Think learning is important? 


02.0% 


02.7% 


08.3% 


12.0% 


74.9% 


H. Allow students to choose what they want to 


42.0% 


16.4% 


24.1% 


07.9% 


09.6% 


work on 

1. Expect students to work out assignments on own? 


15.0% 


10.6% 


26.4% 


15.0% 


32.9% 



40. Please circle the number below to show how you feel about the following ltenr«. 

Item not important aortd >«ry 

It al important important 

It is important that teachers: 

A. Help me do as well as I can on tests. 

B. Teach me about right and wrong. 

C. Show me how to get along with other people. 

D. Discuss drug abuse. 

E. Teach me how to read and writs well. 

F. Make school a pleasant place to be. 
6. Discuss teenage pregnancy. 

H. Discuss suicide. 

I. Care about my future. 



1 


2 


3 


4 


5 


03.3% 


02.9% 


16.3% 


14.7% 


62.9% 


06.2% 


06.4% 


17.2% 


15.8% 


54.3% 


08.5% 


08.5% 


23.2% 


18.9% 


40.8% 


10.9% 


04.5% 


1 2.0% 


12.1% 


60.5% 


04.1% 


02.2% 


08.6% 


13.0% 


72.1% 


03.4% 


03.9% 


17.1% 


19.4% 


56.3% 


16.0% 


06.3% 


17.3% 


14.9% 


45.6% 


16.5% 


07.6% 


18.6% 


13.6% 


43.8% 


05.1% 


03.6% 


09.6% 


12.2% 


69.4% 
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4 1 . Please circle the number below to show how you feel ibout the following Items. 



Item 


Sb^ly 
oisagrra 

1 


2 


sgree 

3 


strongly 
agree 
4 


In my school, 










A. There are unfriendly cliques(groups). 


10.D /fO 


94 3% 


43.1% 


19.0% 


B. Students help each other. 


UD.OvO 




53.8% 


18.1% 


C. Teachers give students extra help with their 
school work. 


UO.U/O 




48.6% 


33.9% 


D. Students try to help each other with their 
school work. 




20.4% 


50.5% 


21.4% 


E. Teachers seem to like the principal. 




14.0% 


48.0% 


31.6% 


P. Teachers seem to like each other. 


04.1% 


11.2% 


50.5% 


34.2% 


G. Teachers seem to like the students. 


07.0% 


18.2% 


49.7% 


25.1% 


H. Students here learn a lot more than students 
from other schools. 


16.7% 


37.1% 


29.5% 


16.7% 


I Students here are expected to do homework 
4*5 times a week. 


09.4% 


14.9% 


39.2% 


36.6% 


J. Teachers care a lot more about their students 
than teachers from other schools. 


1 1 .5% 


28.8% 


35.3% 


24.5% 


K. Most students feel very close to their teachers. 


16.3% 


23.7% 


37.1% 


22.9% 




APPENDIX B.5 
Examples of Volunteer Service Offered by Students 



Sen^e meals at the Rne St Inn (for homeless men) 
Edit a movie 
Work in a store 

Help older people with grocery shopping 

Helping a sick lady and her kids 

Going to the store for eMers 

Help my aunt t)at>ysit 

Going to nursing homes 

Helping elderly people at hospitals 

Babysitting underprivileged kkis. 

Helped with multicultural fair 

Walk for Hunger 

Help at YMCA 

Clean up my mother's house 

Help my neighbors fix their house 

Help dean the park 

Help people le^im to swim 

Help at church 

Help people with groceries 

Do gardening and yardwori< 

Pass out flyers 

Help at library 

Clean Chandler's Pond 

Help at Salvation Army 
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TOPS 



TEST OF PROBLEM SOLVING 

This booklet asks questions about how you wouW solve problems. The problems are 
like those you might find in everyday life, in or out of school. 

There are 31 questions in all. Each one has four possible answers. Please choose 
the answer which you think is best. Mark your answer on the separate answer sheet 
by filling in the circle having the same letter as the answer you choose. Here are two 
examples: 

1 . Which of the following is an animal? 

A. Bed 

B. Box 

C. Chair 

D. Dog 

Since only the dog is an animal, you should have chosen letter D for the first sample 
question. You would show your answer by blackening in the circle on you answer 
sheet with the letter D. It should look like this: 



1 A B C # 



Here is the second sample question: 

2. What is the middle of the day called? 

E. Morning 

F. Noon 
Q. Evening 
H. Midnight 

Since the middle of the day is called "noon," you should have chosen letter F. Your 
answer should look like this: 



2 E # G H 

Make your answer marks heavy and black. Mark only one answer for each question. 
Please answer all of the questions. 



PETS IN THE CLASSROOM 



Mrs. Boyd's dass kept guinea pigs and tropical fish in their classroom. 



Trudy's family gave the class two little guinea pigs and two cages. The students 
wanted to find out if dark whole-wheat bread is better for health and growth than white 
bread. How could they test this? 

A. Give both guinea pigs white bread. 

B. Give both guinea pigs whole-wheat bread. 

C. Give one guinea pig whole-wheat bread and the other white bread. 

D. Give one guinea pig whole-wheat bread and the other no bread at all. 



The students decided to give the two guinea pigs different diets. They weighed the new 
pets each Friday. They kept a grovt^ record and made a chart. 




2. From this chart, tell what happened to the guinea pigs. 



E. Number 1 gained more than number 2. 

F. Number 2 gained more than number 1 . 

G. Both gained the same amount weight. 

H. Number 2 iust ws'ght. 
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3. From this chart, wf at was the difference in weight between the two guinea pigs after 
nine weeks? 

A. Number 1 weighed 6 ounces more than number 2. 

B. Number 2 weighed 18 ounces more than number 1. 

C. Number 2 weighed 6 ounces more than nurber 1 . 

D. Number 2 weighed 12 ounces more than number 1. 



4. Fred took one guinea pig home from school and fed him properly over the weekend. 
The guinea pig seemed calm and rested when Fred returned it to school on Monday 
morning. Carl took the other one home, but he forgot to feed it. On Monday morning 
that guinea pig ran around the cage and bit Carl's fingers. What do you think the 
students learned from this report? 

E. Guinea pigs can live for days without food. 

F. Guinea pigs sleep when they are hungry. 

G. Guinea pigs fight each other for food. 

H. Hunger changes a guinea pig*s actions. 



5. One afternoon the student? were looking at the colorful, tiny, tropical fish in their 
aquarium. Tropical fish are found naturally in waters near the equator. Maria asked: 
"Why is the water in the aquarium heated for these fish?" Which classmate gave the 
best answer? 

A. Jose said: To keep the water from freezing." 

B. Anna said: "To kill harmful germs which might be in the water." 

C. Clyde said: "To keep the water clean and clear for the fish." 

D. Judy said: "To give the fish a home like the one they came from." 

6. The students wanted to add more tropical fish to the aquarium. They learned from the 
expert at the pet store that certain fish couldnl live together. The red fish would eat the 
blue fish; the blue fish would eat the yellow fish but not the red fish; and the yellow fish 
only eat plants. Which color fish should the children put in the same aquarium? 

E. Red and blue fish 

F. Red and yellow fish 

G. Blue and yellow fish 

H. No two colors can live together. 



PLEASE GO TO THE NEXT PAGE. 
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BIKE TRANSPORTATION 



Lots of students like to ride their bikes to the King School, but there have been some bike 
accidents this year. The students in Mr. Brown's dass want to try to make it safer Jind easier 
for students to ride bikes to school. 



7. If Mr. Brown's dass wants to help make bike riding safer, what Infonnation below will 
be most helpful to them. 

A What kinds of bicydes the students have. 

B. Where they bought the bikes 

C. Why the bike accidents happened. 

D. How many bike acddents there were. 



8. The dass invited a policeman to explain bike safety njles. Later John and Jake went 
to the library to look up bike safety rules in some books. They found three safety rules 
which the policeman did not tell them. What do you think they should do? 



E. Tell the policeman he missed three rules. 

F. Use only the mles from the bod^. 

G. Put all the mles together in one list. 

H . Pick the mles they like the best. 



9. John's group dedded to teach bike safety mles to other kids. What shoukJ they do to 
find out how much the students know about bike safety? 

A Make a test of the mles and give it to the students. 

B. Graph the number of kkjs who have had acddents. 

C. Ask the students if they ride bikes safely. 

D. Make a list of the safety njles and ask each student to read it. 



10. Jake's group wanted to find out if the students follow the mles for bike safety. What 
shoi'!d they do to answer this question? 

E. Give a written test on the mles. 

F. Give a questionnaire on what the students do. 

G. Ask the students face to face what they do. 

H. Watch them while they ride their bikes. 
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1 1 Tina's group wanted to find out which bicycle routes the students use to get to and from 
school. They got this information from all the students who rode their bikes to school. 
Then they made a graph. Which triree routes are used the most? 

30 . 

9^ 



20. 




Bike Route 



A. A. B, and E. 

B. B, D, and E. 

C. C. 0. andE. 

D. D.E.andF. 



12. The students decided to concentrate on the three routes which the bike riders use 
most. What additional information should the stucients get about these routes? 

E. How many bike accidents happened on each route. 

F. How many students keep their bikes in good condition. 
Q. How many students take the bus instead. 

H. Which route is the shortest one to school. 



PLEASE GO TO THE NEXT PAGE. 



THE WINDOW SILL GARDEN IN MRS. JACKSON'S CLASS 



The students in Mrs. Jackson's science class were conducting experim^ r.s on conditions 
that affect the growth of plants. First, they wanted to find out if plants grow better in natural 
sunlight or under electric grow lights. They considered two hypotheses. (Hypotheses are 
por :ible explanations.) 

Hypothesis I: Plants grow batter In natural sunlis^ht. 
Hypothesis II: Plants grow better under electric grow lights. 

They put one plant on the window sill and an identical plant under grow lights on a shelf 
away from the window. The students kept a notebook on the growth of the two plants. In 
the next four questions, items 13 to item 16. determine which hypothesis is supported by 
notes the students made. 

13. After two weeks, the plant grown in natural sunlight was B inches tall and the plant 
grown under grow lights was 5 inchv9S tall. Which hypothesis does this information 
support? 

A. Only Hypothesis I 

B. Only Hypothesis II 

C. Both Hypothesis I and Hypothesis II 

D. Neither Hypothesis I nor Hypothesis II 

14. The leaves were smaller in the olant grown in natural sunlight than in the plant grown 
under grow lights. Which hypothesis does this obsen/ation support? 

E. Only Hypothesis I 

F. Only Hypothesis II 

G. Both Hypothesis I and Hypothesis II. 

H. Neither Hypothesis I nor Hypothesis II. 

15. Both of the plants developed t:' illow spots on the under sides of the leaves. Which 
hypothesis does this information support? 

A. Only Hypothesis I 

B. Only Hypothesis II 

0. Both Hypothesis I and Hypothesis II 

D. Neither Hypothesis I nor Hypothesis II 

16. After ten weeks, the plants were cut off at the soil line, washed, and weighed. The 
plant grown in natural sun light weighed 15 grams, and the plant grown under grow 
lights weighed 11 grams. Which hypothesis does this information support? 

E. Only Hypothesis I 

F. Only Hypothesis II 

G. Both Hypothesis I and Hypothesis II 

H. Neither Hypothesis i nor Hypothesis II 



1 7. Tom wanted to test whether fertilizer would really make plants grow better. He 
thought of three different experiments. 



«i 



, Add fertilizer to one pot 

of soil. Plant three bean seeoG in the 30t. 
Give each plant the same care, a\nd 
watch their growth. 



gxperimflnt #2: Get two potS Of soil. Add 
fertilizer to the soil of both pots. Plant 
three bean seeds in each pot. Give the 
same care, and watch the plant growth. 



gxperimflnt #3 : Get two pots of soil. Add 
fertilizer to one of the pots. Plant three 
been sesds in each pot. Give each pot 
the same care and watch the plant 
growth. 



Fertilizer 



»2 



JUL 

Fertilizer 




Fertilizer 



#3 



m YYV 



Fertiizer 



^4o Fertilizer 



Whiwh exper'.nent would show if the fertilizer was good for the plants? 

A. Experiment #1 

B. Experiment #2 

C. Experiment #3 

D. None of the experiments would tell whether the fertilizer was helping. 



18. Tanya wanted to see which type of soil would be best for growing plants from seeds. 
She found three flower pots and filled the first with loam, the second with sand, and the 
third with clay. Then she planted three bean seeds in each pot. Tanya placed the pots 
side by side on the window sill and gave each pot the same amount of water. 




Loam Sand Qay 



The bean plants grew best in the loam. Why did Mrs. Jackson say this experiment 
wus NOT a good experiment and did not prove tht loam was the best soil for plant 
growth? 

E. The plants in one pot got more sunlight than the plants in the other pots. 

F. One pot should have been placed under grow lights. 

G. The students should have tried different kinds of seeds. 

H. The amount of soil in each of the pots was not the same. 
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A BUSY CORNER 



Most students walk to the Franklin School, and they have to cross the street at the comer of 
Lincoln Avenue and Broadway. This is a very busy intersection, with speeding cars and no 
traffic light or stop sign. Although there is a crossing guard, she is afraid there will be a 
serious accident. 



19. Mrs. Carter's dass talked about the problem one morning. The students asked many 
questions. Which question do you think was the most important for solving the 
prot>lem? 

A What time of day is the crossing guard on duty? 

B. Who has the right of way, drivers or walkers? 

C. What do the red, yellow, and green colors of a traffic light mean? 

D. How can the intersection be made safer? 



20. They decided to try to do something about the problem. What would be the most 
important thing to work on? 

E. Have all the parents drive the kids to school. 

F. Ask for an extra crossing guard. 

G. Figure out how to stop the speeding cars. 

H. Find out how many others are afraid. 



21 . One group wanted to measure how long it takes to cross the street. How should they 
doit? 

A Measure the width of the street with a tape measure. 

B. Time the cars going by with a stop watch. 

C. Time the kkjs going across with a stop watch. 

D. See who can cross the fastest. 



ERIC 



7 



22. 



Carlos and Fred decided to time Lee crossing the street. Carlos said it took Lee eight 
seconds; Fred said it took ten. They both used stop watches. What should they do 
now? 



E. Try again, using new stop watches. 

F. Try again, using the teacher's wrist watch. 

G. Try again, both starting when Lee steps off the curb and stopping when he steps 
on the curb on the other side. 

H. Try again, but this time tell Lee to run from curb to curb in exactly eight seconds. 



23. Carlos and Fred timed adults and students from each grade as they crossed the street. 
They found that the average crossing time was 11 seconds. What would you suggest 
to make the crossing safer? 

A. Put up a walk light that stops cars for 1 1 seconds every two minutes. 

B. Put up a walk light that stops cars for 1 5 seconds every two minutes. 

C. Teajh everyone to cross the street in less than 1 1 seconds. 

D. Have the crossing guard stop traffic every 1 1 seconds. 



24. Mrs. Carter's class has written a report about their study of the busy corner. The report 
includes recommendations based on the data they collected. What do you think they 
should do now? 

E. Get permission to tell other children in the Franklin School about their project. 

F. Ask Mrs. Carter to grade the students for their work on the project. 

G. Ask the principal for materials to build a traffic light. 

H. Invite someone from the police department to listen to their report. 



PLEASE GO TO THE NEXT PAGE. 
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A CLASSROOM TEMPERATURE CHART 



Mr. DaCosta's classes kept a record of hourly temperatures indoors and outdoors, on a fall 
day. Their data looked like this: 



Temperature Readings in po on October 1st 

8a.m 9 a.m. 10 a.m. 11a.m. 12 noon 1p.m. 2.p.m. 3.p.m. 



Indoors 62© 71© 80© 75© 72© 74© 75© 72© 

Outdoors 61© 65© 68© 72© 78© 82© 79© 75© 



Use the information from this chart to answer questions 25 through 31. 



25. At what time was the room too cold for comfort? 

A. 8 a.m. 

B. 9 a.m 

C. 1 p.m. 

D. 3 p.m. 



26. What time of day was it necessary to open the windows to make the classroom 
comfortable? 

E. 8 a.m. 

P. 9 a.m. 

G. 10 a.m. 

H. 12 noon 



27. When was the increase in outdoor temperature the greatest? 

A. Between 8 a.m. and 9 a.m. 

B. Between 9 a.m. and 10 a.m. 

C. Between 11 a.m. and 12 a.m. 

D. Between noon and 1 p.m. 
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28. 



On a day like this, when would students most likely need a sweater? 



E. Only In the morning 

R Only in the afternoon 

G. OuMoors throughout the day 

H . Indoors throughout the day 

29. If a student wore a sweater or jacket to dass, Ijetween what hours would he probably 
want to take it off? 

A. Between 9 a.m. and 10 a.m. 

B. Between 10 a.m. and 11 a.m. 

C. Between 10 a.m. and 12 noon 
0. Between 2 p.m. and 3 p.m. 

30. When was there the greatest difference between indoor and outdoor temperature? 



E. 

F. 
G. 
H. 



9 a.m. 

10 a.m. 
12 noon 

1 p.m. 



31. The thermometers drawn below show the indoor and outdoor temperatures for what 
time of day? 



A. 
B. 
C. 
0. 



9 a.m. 
11 a.m. 

2 p.m. 

3 p.m. 



Indoor Thermometer 

-90 

-80 
-70 



Outdoor Themiometer 

n 

'90 
'80 
'70 



-60 



80 



THE END. 

THANK YOU FOR ANSWERING THESE QUESTIONS. 
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EXAMEN DE RESOLVER PROBLEMAS 



Este libreto hace preguntas en cuanto a cc5mo resuelves problemas. 
Los problemas son parecidos a aquellos que encuentras todos los 
dias, en o fuera de la escuela. 

Encontraras 31 preguntas, Cada una tiene cuatro posibles respues- 
tas. Por favor, escoge la mejor contes taci(5n • Marca tus respuestas 
en el otro papel oscureciendo el circulo que tiene Ic. misma letra 
de la respuesta que escojas, Aqui tienes dos ejemplos: 

1. cCual de los siguientes es un animal? 

A. cama 
caja 
silla 

D. Perro 

Como solamente el perro es un animal, debes haber escogido la letra 
D para la primer pregunta de ejemplo, Demostraras tu respuesta 
oscu-;eciendo el circulo en tu hoja de respuestas con la letra 
Debe verse de la siguiente manera, 

1. A B C # 

Aqui esta el segundo ejemplo: 

2. ^Como se le llama a la mitad del dia? 

E. Manana 

F. Medio-dia 

G. Tarde 

H. Media-noche 



Como sabemos que se le llama "medio-dia", debes haber escogido la 
letra F. Tu respuesta debe verse de la siguiente manera. 

2, E # G H 

Has tus marcas bien fuerte y negras. Marca una respuesta solamente 
por cada pregunta. Por favor, contesta todas las preguntas. 
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ANIMALES DOMESTICOS EN EL SALON DE CLASE 



La clase de la Sra, Boyd tenia conejillos de Indias y peces tropi 
cales en su sal(5n de clase. 

1, La familia de Trudy le regalo^ a la clase dos conejillos de 
Indias y dos jaulas, Los estudiantes querian saber si el 
pan de trigo-puro era mejor que el pan olanco para la salud 
y el crecimiento • Como podrian averiguarlo? 

A, Dandole a los dos conejillos pan bianco, 

Da'ndole a los dos conejillos pan de trigo-puro, 

C. Drfndole a un conejillo pan de trigo-pur^ y al 
otro pan bianco, 

Dandole pan de trigo-puro a un conejillo y no darle 
nada al otro. 

Los estudiantes decidieron darle a los dos conejillos dietas 
diferentes. Ellos pesaban los initnales domtfsticos todos los 
viernes. Tambie'n mantenian un registro de crecimiento e hicieron 
una esquema grafica. 




2 

0 

1 23456789 semanas 



2. Deja'ndote llevar por este esquema grafico, cuenta lo que le 
paso' a los conejillos de Indias. 

E. Numero 1 aumento' mas que numero 2. 

F. Numero 2 aumento mas que ntjmero 1. 

G. Los dos pesaron lo mismo. 

H. Numero 2 rebajo** de peso. 



3, Del esquema grafico, cu^l fue la difeiencia en peso entre los 
dos conejillos despues de nueve semanas? 

A. Numero 1 peso' 6 onzas mas que numero 2, 

B. NOmero 2 pescf 18 onzas mas que numero 1, 

C. N6mero 2 peso' 6 onzas m^s que n6mero 1. 

D. Niimero 2 peso' 12 onzas mds que niSmero 1, 

4, Fred se llevo' un conejillo de la escuela a la casa y lo alime^-^to' 
apropiadamente por un fin de semana. El conejillo lucia en cal- 
ma y descansado cuando Fred lo devolvio'' a la escuela el lunes en 
la maffana. Carl se llevo' el otro conejillo a su casa, pero se 
olvido^ de alimentarlo. El lunes en la maSana . el conejillo coma 
alrededor de la jaula y mordio' a Carl en los deaos, ^Que crees 
que los estudiantes aprendieron de este reporte? 

E. Conejillos de Indias pueden vivir sin comer por dias, 

F. Conejillos de Indias duermen cuando tienen hambre, 

G. Conejillos de India pelean unos con otros por comida. 
El hambre cambia las acciones de los conejillos, 

5, Una tarde los estudiantes estaban mirando su pecera llena de 
pequenos peces tropicales de muchos colores, Los peces tropicales 
se encuentran en aguas cerca del ecuador, Maria pregunto: " ^Por 
que se calienta el agua de la pecera para estos peces?" ^^Quien de 
los estudiantes did la respuesta correcta? 

A, Jose dijo: "Para que el agua no se frise". 

Ana dijo: "Para matar germenes que pueden estar en el agua", 

C, Clyde dijo: "Para mantener el agua limpia y clara para los peces"- 

D- Judy dijo: "Para darles un hogar como el que ellos tenian". 

6- Los estudiantes querian anadir mas peces en la pecera- Ellos apren- 
dieron de los expertos en la tienda de animales dom^sticos que algu- 
nos peces no pueden vivir juntos. El pez rojo se come al pez azul; 
el pez azul se come al pez amariilo pero no al pez rojo; y el pez 
amarillo solamente come plantas. (fQu^ color de peces los estudiantes 
pueden poner juntos en la pecera? 



E. Peces rojos y azules 

F. Peces rojos y amarillos 

G. Peces azules y amarillos 

H- Dos colores no pueden vivir juntos- 




POR FAVOR , PASA A LA PROXIMA PAGINA 



ERIC 



-2- 

447 



BICICLETAS COMO TRANS PORTE 



A muchos estudiantes les gusta guiar sus bicicletas a la escuela King, 
pero han ' abido algunos accidentes de bicicletas este ano, Los estu- 
diantes de la clase de Mr, Brown quieren tratar de hacerlo mas seguro 
y ficil pa.-, los estudiantes que guian sus bicicletas a la escuela • 



1. Si los estudiantes de Mr, Brown desean hacer que el transporte en 
bicicleta sea m4s seguro, gcu/l de la inf ormaci<5n provista mas 
adelante serxa de mas ayuda para ellos. 

A. La clase de bicicletas que los estudiantes tienen, 

B. Donde compraron sus bicicletas • 

C. Por que suceden los accidentes de bicicletas, 

D. Cuantos accidentes de bicicletas han tenido, 

8. La clase invito' a un policia para que explicara las reglas de 
seguridad al mane jar bicicletas, Despues, John y Jake fueron 
a la biblioteca a buscar libros que tuvieran informacion sobre 
estas reglas. Ellbs encontraron tres reglas de seguridad que 

el policia no habfa mencionado, g'Que crees que ellos deben hacer? 

£• Decirle al policia que se le olvidaron tres reglas, 

F, Usar solamente las reglas que encontraron en los libros, 

G, Poner todas las reglas juntas en una lista. 

H, Escoger las reglas que mas le gusten, 

9, El grupo de John decidid ensenar a otros nifTos las reglas de segu- 
ridad, c'Qu^ deben ellos hacer para averiguar cuanto saben los 
estudiantes u cerca de el manejo de bicicletas con seguridad? 

A, Hacer un examen de reglas y darcelo a los estudiantes. 

B, Hacer un esquema grafico del numero de estudiantes que 
han tenido accidentes, 

C, Preguntar a los estudiantes si ellos manejan sus bicicletas 
con medios de seguridad, 

D, Hacer una lista de las reglas de seguridad y pedirle a los 
estudiantes que la lean, 

10. El grupo de Jake queria saber si los estudiantes habian seguido 
las reglas para seguridad al mane jar sus bicicletas. ^'Que deben 
ellos hacer para contestar esta pregunta? 

E, Dar un examen escrito de las reglas. 

F, Dar un cuestionario de lo que los estudiantes hacen, 

G, Preguntar a los estudiantes personalmente lo que ellos hacen. 

H, Observarlos mientras ellos manejan sus bicicletas. 
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11. Tina querjfa saber las rutas que los estudiantes seguian en sus 
bicicletas para ir a la escuela y regresar. Ellos obtuvieron 
esta informacidn de los estudiantes que ^viajaban en bicicleta. 
Despues, ellos hicieron este esquema grafico. De las tres 
rutas, (ijcual se usa mas? 

30 . 



25 




Rutas de Bicicletas 

A. A, B y E 

B. B, D y E 

C. C, D y E 
D, E y F 

12. Los estudiantes decidieron concentrarse^ en las tres rutas qu mas 
usan los que viajan en bicicleta. c^Que otra informacion deb nan 
obtener los estudiantes a cerca de estas rutas? 

E. Cu^ntos accidentes de bicicletas ocurre en cada ruta. 

F. Cuantos estudiantes mantienen sus bicicletas en buenas 
condicjones. 

G. Cuantci estudiantes prefieren via jar en autobus. 

H. Cual es la ruta mas corta a la escuela. 
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EL JARDIN DE UMBRAL EN LA 
VENTANA DEL SALON DE MRS. JACKSON 



Los estudiantes en el saldn de ciencia de Mrs, Jackson estaban haciendo 
experimentos de las condiciones que afectan el crecimiento de las plan- 
tas, Primero, quer£an saber si las plantas crecen mejor bajo los rayos 
del*sol o bajo luces ele'ctricas, Ellos consideraron dos hipotesis. 
(Hipotesis significa explicaciones posibles), 

Hipotesis I: Las plantas crecen mejo.v bajo los rayos del sol, 
Hipotesis II: Las plantas crecen mejor bajo luz ele'ctrica, 

Ellos pusieron una planta en el umbral de la ventana y una planta 
identica bajo luz ele'ctrica lejos de la ventana, Ellos mantuvieron 
una libreta con el crecimiento de las dos plantas. En las cuatro 
preguntai; siguientes, del 13 al 16, detormina cual de las hip6tesis 
es apoyada por las notas que los estudiantes hicieron. 

13. Despues de dos semanas, la planta que tenian bajo los^ rayos del^ 
sol media 8 pulgadas de alto y la planta bajo luz electrica media 
5 pulgadas. (fA Cual de las dos hipotesis apoya esta informacion, 

A, Solamente Hipotesis I 

B, Solamente Hipo'tesis II 

C, Las dos- HipcJtesis I Y^H 

D, Ninguna de las dos Hipotesis 

14. Las hojas eran mas pequeffas en Ic planta que crecio' bajo los rayos 
del sol, £j'Cual de las Hipotesis apoya esta observacion? 

E, Solamente Hipotesis I 

F, Solamente Hipotesis II 

G, Las dos - Hipdtesis I y II 

H, Ninguna de las dos Hip6tesis 

15, Las dos plantas desarrollaron manchas amarillas debajo de las hojas, 
iCual de las Hipotesis apoya esta informacion? 

A, Solamente Hipdtesis I 

B, Solamente Hipotesis II 

C, Las dos - Hipdtesis I y II 

D, NingGna de las dos Hipdtesis 

16, Despues de di-^'z semanas, cortaron las plantas desde la superficie 
de la tierra, las lavaron y las pesaron. La planta que habia 
crecido bajo los rayos del sol pesaba 15 gramos y la planta que 
crecicTbajo luz electrica peso'' 11 gramos, ^Cual Hipdtesis apoya 
esta informacion? 

E, Solamente Hipotesis I 

F, Solamente Hipo^'tesis 11 

G, Las dos - Hipo'tesis I y II 

H, Ninguna de las dos HipcJtesis 
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17 • Tom querfa saber si el uso de f ertilizantes en verdad hacia 
que las plantas crecieran mejor. El pansd en tres experimen 
tos diferentes. 



Experimento >1» Ponga fertilizante 
en un embase con tierra. Siembre 
dos habichuelas en el embase. Cui- 
delas de la misma forma y observe 
bU crecimiento. 

Experimento >2» Consigue dos embases 
con tierra. Kecha fertilizante en 
la tierra de los dos embases. Siemjra 
tres semillas de habichuela en cada 
embase. Cuidalas de la misma forma y 
observa el crecimiento. 

Experimento >3» Consigue dos embases 
con tierra. Hecha fertilizante a uno 
de los embases. Siembra tres semillas 
de habichuela en cada embase. Cuidala 
de la misma forma y observa su creci- 
miento . 

^Cual experimento enseflar^ si el fertilizante fue bueno para las 
plantas? 

A. Experiir-^nto #1 
6. Experimento #2 

C. Experimento #3 

D. Ninguno de los experimentos probara si el fertilizante ayudaba. 

i8. Tana queria sailer qua clase de tierra era mej^or para que las 

semillas de plantas crecieran. Ella encontro dos embases con 
tierra de plantas de f lores y llenrf el primero con marga, el 

segundo con arena y el tercero con arcilla. Despu6s, ella 

sembrd tres semillas de habichuela en cada embase. Ella^ puso 

los embases uno al lado del otro en la ventana y les dio a 

cada embase la misma cantidad de agua . 




marga arena arcilla 

Las semillas de habichuelas creqieron mejor en la marga. c ?or qu^ 
Mrs. Jackson dijo que este no era un buen experiir.ento y que no 
provo que la marga epa la mejor tierra para crecer plantas? 

E. Una de las plantas recibio ma^'s l^z del sol que las otras . 

F. Uno de los embases debicT haberse puesto bajo luz electrica. 

G. Los estudiantes debieron haber tratado diferentes semillas. 

H. No habia la misma cantidac* de tierra en cada embase 




fertilizante 
fertilizante fertilizante 
fertilizante Sin fertilizante 



UNA ESQUINA OCUPADA 



La mayoria de los estudiantes caminan a la escuela Franklin y tienen 
que cruzar la esquina de las avenidas Lincoln y Broadway, Esta es una 
interseccidn de mucho trafico, carros con mucha velocidad y no hay luz 
de trafico ni sehal de "pare", Aunque hay un guardia que ayuda a cruzar 
la calle, ella teme que haya un accidente serio. 

19, La clase de la Sra • Carter hablo' de ese problema una manana, Los 
estudiantes hicieron muchas preguntas, ^Cual de las preguntas tu 
crees que fue la mas importante para resolver el problema? 

A. tA que'' horas del dia se puede conseguir el guardia? 

B. iQuien tiene derecho al paso, los ch(5feres o los peatones? 

C. (^Qutf significan los colores rojo, amarillo y verde en las 

luces de trafico? ^ 

D. ^Como podemos hacer de esta una interseccion segura? 

20, Ellos decidieron que tratarian de hacer algo para resolver el 
problema. ^Que' seria lo mas importante para que ellos trabajaran? 

E. Hacer qi:*^ todos los padres lleven sus hijos a la 
escuela en sus carros. 

F. Pedir que se pcnga un guardia adicional. 

G. Averiguar come parar los carros que llevan mucha velocidad. 

H. Av'»riguar cuaTnta otra gente tiene miedo. 

21, Un grupo queria medir cu^nto tiempo tomaba cruzar la calle. 

Como podrian hacerlo? 

A. Medir el ancho de la caJle con una cinta de medir. 

B. Coger el tiempo de los carros que pasan con un reloj de tiempo. 

C. Coger el tiempo de los ninos que cruzan con un reloj de tiempo. 

D. Ver quien puede cruzar mas ra'pido. 
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22 • Carlos y Fred decidieron tomar tiempo de Lee cruzando la calle. 
Carlos dijo que a Lee le tome/ ocho segundos; Fred dijo que le torn 
diez. Los dos usaron relojes de tnedir tiempo, ^QueT deben hacer 
ahora? 



£• Tratar otra vez, usando relojes nuevos • 

F, Tjatar otra vez, usando el reloj de su maestro, 

Tratar otra vez, comenzandc desde que Lee baje de la cera y paran- 
do cuando el llegue a la cera del otro lado de la calle, 
H, Tratar otra vez, pero esta vez , decirle a Lee que corra de una 

cera a la otra en ocho segundos. 



23, Carlos y Fred tomaron el tiempo de adultos y estudiantes de todos 
grados cruzando la calle, Se dieron cuenta de que por lo general 
el cruzar la calle se toma^ once segundos. Que sugeririas para 
hacer que el cruce sea mas seguro ? 

A, Poner una luz de traficv^ que pare a los carros por 11 segundos 
de cada dos minvtos, 

B, Poner una luz de tr^fico que pare a los carros por 15 segundos 
de cada dos minutos, 

C, EnseKar a todo el mundo a cruzar la calle en menos de 11 segundos, 

D, Hacer que el guardia pare el trafico de cada 11 segundos. 



24, La clase de la Sra, Carter escribio'^un reoorte a cerca del estudio 
de la esquina ocupada. El reporte incl*. ye recomendaciones basadas 
en la informacidn que alios encontraron. ^Que crees que ellos deben 
hacer ahora? 

E, Obtener permiso para decirle a otros nifTos de la escuela 
Franklin a cerca de su proyecto, 

F, Pedirle a la Sra, Carter que les nota a los estudiantes 
por su trabajo en el proyecto, 

G, Pedirle al principal materiales para hacer una Ijz de 
trafico, 

H, Invitar a una persona del departamento de policias para 
que venga a escuchar sobre su reporte. 
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GRAFICA DE TEMPERATURA 
EN UN SALON DE CLASES 



La clase de el Sr. DaCosta mantuvo un archive de tempera tura de cada 
hora adentro y fuera en un dia de otono. Su informacion lucia de la 
siguiente manera. 



Lectura de Temperatura en F* el Iro de octubrc 
STm 9im 10t.m. 11 t.m. 12 noon 1 p.m. 2.p.m. 3.p.m. 



620 710 80© 750 720 740 750 72© 
610 650 680 720 730 820 790 750 



Usa la informacion en esta grafica para contestar las preguntas del 
del 25 al 31. 



'25. A que hora el salon estaba muy frio para ser comodo? 

A. 8a.m. 

B. 9 a.m. 

C. 1 p.m. 

D. 3 p.m. 

26. A que hora del dia era necesario abrir las ventanas para hacer 
que el salon estuviera comodo? 

E. 8 a.m. 

F. 9 a.m. 

G. 10 a.m. 

H. 12 medio dia 

27. Cuando fue mas grande el aumento de temperatura afuera? 

A. Entre 8 a.m. y 9 a.m. 

B. Entre 9a.m.yl0a.m. 

C. Entre li a.m. y 12 a.m. 

D. Entre el medio dia y 1 p.m. 



adentro 
aiuera 
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28. En un dia como es te ,^cua'ndo crees que los estudiantes necesitaran 
un sueter? 



E. Solamente en la maffana 

F. Solamente en la tarde 

G. Afuera todo el dfa 

H. Adentro todo el dfa 



29 



Si un estudiante usa un sueter o un abrigo para venir a clases. 
^entre qu^ horas es mas probable que quiera quit^rseloC 



A. Entre 9 a.m. y 10 a.m. 

B. Entre 10 a.m. y 11 a.m. ^ 

C. Entre 10 a.m. y 12 del medio dia 

D. Entre 2 p.m. y 3 p.m. 



30. (jCuando habia la mayo 
y la de afuera? 



r diferencia entre la temperatura de adentro 



E. 9 a.m. 

F. 10 a.m. ^ 

G. 12 medio dia 

H. 1 p.m. 



31. Los termometros dibujados aba jo enseflan la temperatura de 
que' hora del dia? 



A. 9 a.m. 

B. 11a .m. 

C . 2 p.m. 

D. 3 p.m. 



Termc^metro de adentro Termdmetro de afuera 



•90 
•80 
-70 
-00 



FIN 

GRACIAS POR CONTESTAR ESTAS PREGUNTAS 
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TEST OF PROBLEM SOLVING 



Quyen top nay qth cd nhiing cSu hoi vd* nt\iS\q phiidng thiic giai i3ap nhufig van if 
ma cac em cd the g18p trong fld'i sdng hang ngay, trong ho9c ngoai tnidng hoc. 

Cd tat ci 31 cSu hit. Mdi ciu hoi cd 4^iri ]J\. Chpn cfiu ira idl ma em ngnT la 
dung nhat. Va ilanh dau vao Pang tra Id'i Pdng each d1§n vao vdng trdn cd chijf 
tnJdng SUdng. Sau Qiy la 2 th'i du: 



I. Trong nhiing mgc dt/dl diy, cai ndo Id Qdng vdt? 
A. GiUdng ngd 
8. Cai hdp, 
C. C^l ghi 
0. Con chd. 

Bdj vf con chd la ffOng vat. em nin chon^ctnf 0 trong th'i du tr§n. Em se tra 1di 
bfing each td Qdm chi) 0 trong ban irh Idi nhd sau: 

I. A 6 C # 



Thi du thd hai: 

2. Thdi gian g'ida ngay gqi la gi? 

E. Bud't sang 

F. Bu^i trua^ 

G. Bu6\ chiiu 

H. Bu^i toi 



vf thdi gian giJa ngay la Pud'i tnJa. em nen chon chit F. Cau tra Idl cua em se 
gidhg nhii sau: 



2. E # 6 H 

-Oanh dau tra Idi ro rang. Chi' danh dau mot tra Id'i cho mdi cau hoi va tra Id'i tat 
ca cac cau hoi 



THU VAT TRONG PHONG HOC 



Trong Idp hoc cua ba Boyd c6 hai con heo va nhJng con ca vung nhiet 9di. 

1. Gia ainh Trudy t$ng cho Idp hoc hai con heo va hai cai chuong. Hoc sih nnuon bie't giiio 
hai lo.ai banh-nnf trang va banh nni aen, loai nao thi'ch h()p hdn cho si/c khde va tJng trJ 
dhg. Hoc sinh phai lann thi' nghienn nhi/ the nao? 

A. Cho ca hai con heo ffn banh mi trSng 

B. Cho ca hai con heo ?n banh mT den 

C. Cho nnot con 5n banh nni trSng va nnqt con an Danh nrif den 
0. Cho mot con an banh m? den va con con lai khdng cho an. 

Hoc sinh quye't dinh nuoi 2 con heo bfing haj loai thdc pham khac nhau. Ho can ca 2 con 
vao mdi ngay thuf sau. Ket qua dCi6c lilu triJva ho lam bang 96 thi nhii sau: 




23456789 
tuan le 



2. Dda trtn ban 00' thi ndy. chuyfin gT d8 x8y ra gida hai con heo 

E. Con heo s6 1 cdn n^ng hon con heo s6 2 

F. Con heo so 2 can nang hdn con heo so 1 

G. Ca hai con can nang bang nhau 

H. Con heo so 2 bi giam ky 
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3. Ti/bon aa'thj tren, hal con heo khec biSt boo nhieu ky-16 sou mot thdi gion lo 3 tuon 

A. Con sd 1 nSng hdn con sd 2 la 6 ky-1d 
6. Con sd 2 n$ng hdn con so lla 18 ky-16 

C. Con so 2 nang hdn con so 1 la 6 ky-ld 

D. Con sd 1 n^ng hdn con sd 2 la 12 ky-ld 

4. Fred mang I con heo ve nha va cho 5n flay flu vao ngay cudi tuan. Va mang tra loi Itfp 
VQo ngay thil Hal. Con heo cua Fred cd yen l^ng ve nghi ngdi. Carl cung mang 1 
con v§'nha nhiing anh ay quen cho Sn. Vao hdm tht( Hai, con heo cua Carl chay xung 
quanh chudng va c5n vao ngdn tay cua Carl. Theo em nghT, hoc sinh hoc hoi gf t J 
nhdng sU kien tr§n? 

E. Heo CO th§ song ma khdng can thuc pham trong vdng vai ngay 

F. Heo se ngu khi no fldi 

G. Heo tranh glanh nhau v^ thdc phdm 

H. Si/ Qdl 1am thay s6\ hanh ddng cua con Heo. 

5. Vao mdt bud'i tnJa, hoc sinh nhfn vao nhiing con ca vCing nhiet^fldi rUc rd mau s8c 
trong hd'ca cua Idp. Ca nhjdt 9d1 thUdng cd trong nhuTig ao hd vCing gdn dOdng xich^ 
flao. nana hoi; "tai sao nildc trong hd ca phal QUdc sddi dm?*. Trong nhJng cau tra 
Idi sau, cau tra Idl nao dung nhat? 

A. Jose ndi: 'de'giii cho niiOc khoi 9dng,ddc* 

B. Anna ndi: "ffe giet vi khuon trong nildc" 

C. Clyde ndi: "de giii cho nddc BUdc trong va sach' 

D. Judy ndi: 'fle tao mdt mdi tru'd'ng sdhg thi'ch hdp cho nhiing con ca" 

6. Hoc sinh mud'n bo them nhUng con ca nhldt flol vao trong hd'ca cua ho. Ho ffUbc nhdng 
nha chuyen mon cho biet rdng cd nhiing loai ca khdng the cung ci vdi nhau. Ca do se 
5n CQ xanh; ca xanh se on ca vang nhiing khdnq on c6 du; ca vang chi 6n rong reu. Hoc 
sinh nen bo nhdng loai ca nao vao cung mdt hd? 

E. Co do vd ca xanh 

F. Ca do vd ca vang 

G. Co xanh va ca vang 

H. Hai loai ca khac mau khdng the sdng vdi nhau. 



Di CHUYEN bXnG XE-DAP 



Nhieu hoc sinh dung xe dap 6i ddn tni6ng King. Nhiing c6 vai tnJdng hdp tai nan xe 
fl^p trong nJm ray. NhJng hoc sinh trong Ibp hgc cua 6ng Brown cfi'gfing tqo flieu kien 
an loan va de dang cho hoc sinh d^p xe flop J1 hoc. 

7. Niu Idp hQC ong^Brown nnudn giup cho van de di xe dap dU6c an loan hdn, dJ kien nao 
sau day dddc hiiu dung nhdt 

A. Hoc sinh CO nhtJng loai xe d^p nao 
6. Hoc sinh mua xe dap d dau 

C. Tai SCO tai nan xe dqp xSy ra 

D. Bao nhieu tai nan dS x9y ra. 

8. Hoc sinh mdl m$t canh sot vl^n tdi d§ glai thich nhJng lu^t 1e an toan ve^xe d9p cho 
hoc sinh. Sau dd, John va Jake d1 Qeh thd vi§n vajtim nhdng ludt 1$ an toan vd'xe dap 
trong sach. Hp tlm th^y cd_3 1u$t an toan ma ngii6i canh sat vien dS khong ndi tdi. 
Theo em nghT, hp nen lam gi? 

E. Bao cho ngddi canh sat vidn Diet rSng dng ta thi§u sdt 3 ludt. 

F. Chi dung nhdng lupt trong sach 

G. Liet k§ tat ca cac ludt 1$ 

H. Chi'chon nhdng lu^t le ma hp thich nhat. 

9. Nhdm ciia John o'lydt di.nn day nhdng luat II an toan cho nhdng tre em khac. Ho 
mudn tim hieu v sd hi^u bih vg luat an toan xe dap cua nhdng hoc sinh khac. Hp 
phai 1am thi nao dlT tlm hidu? 

A. Cho hoc sinh lam mOt bal thi ve tat ca cac luqt le 

B. Ve mot dfl'thi ve s6 hpc sinh bi tai nqn 

C. Hoi xem hoc sinh cd lai xe dap an toan hay khdng 

0. Lam m^t ban vd^nhJng ludt If an toan va bao hoc sinh doc. 

10. Nhdm cua Jake mudn tim hiSu xem hoc sinh cd tuSn theo nhdng luat an toan v§ xe 
dap hay khdng. Hp phai lam thd nao? 

E. Cho mot bai thi vl cac luat IS 

F. Cho nhdng cau hoi van dap ve nhdng gi ma hoc sinh lam 
6. Trdc tiSp hoi hoc sinh 

^ H. Theo doi hoc sinh trong luc hp dang di xe dap. 
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1 1. Nhom cue Tino mu6n bi'ei hoc sinh flap xe tren nhdng con auOng noo OS fli hoc. Ho hbi 
tat ca hQc sinh flop xe 31 hpc va lam mot ban ao'thi aiSu nay. OJa theo ban do'thi, 
3 ffU6ng nao flildc dung nhieu nhk? 





JBm_ HH Mil 


i'i: I'll 


:iaiii 

V'\H\\[U' ';i<ii;r> ^1 .)t.;:i'> 



A B C 0 E F 



A. A. e.v^E 

B. B.D,v6E 

C. C. D. E 

D. D, E. v6F. 

12. Hoc sinh quyet 91nh chu trpng vao 3 con dUdng nna^ngijdi fli xe flap dung nhieu nhk. 
NhUng tin ti^c phu nao ma hqc sinh nen bi§t ve~ nhdng con fliJ6ng ay ? 

E. 6ao nhteu tai nan xe flap fl9 xay ra tr§n mdi fliidng 

F. Bao nhieu hoc sinh bao tdn xe dap cua ho tot 

G. Bao nh[6u hoc sinh dung xe bus thay vfxe flap fle fli hoc 

H. Con flU6ng nao ngSn nhat fli fli fldn tnJdng. 



TiEP TUC d TRANG kI 
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KHU VJdNG BEN CANH CUfA SO TR0N6 l6p HOC cClA BA JACKSON 



Hoc sinh trong Idp hoc cue bo Jackson lam mot cuoc tht nghiem ve nhilng Oieu kien anh 
hdbng flen stl phet trien cua cay c6i. TnJbc hS't. hp mubn biet cay cbi phet then tot hdn 
diidi anh $ang thien nhien (anh sang mfit trdi) hay di/bi anh sang nhan tao (anh sang cua 
9en di^n). Hp suy xet hai gial thuyet: 

6iai thuyet i : cdy cdl phat irMin tdt hdn dU6l anh sang thiin nhi§n 
6ial thuyh II: ciy c6i phat tn§n t6t hdn dUdI anh sang Oen ai$n. 

Hp 98t mdt cay goh b|n ciia so va nr)pt cay tUbng til nh Jng xa cJe sd* ve dUdi anh sang 3en 
3ien. Hoc sinh liiu trU nhUng dUkien v§ su phat triS'n cua 2 cay Sy. Trong 4 cau hoi k'e 
uep. cau hoi 13 den 16. xac di.nh xem giai thuyet nao QUpc chUng minh bdi nhiing dJkien 
do hoc sinh li/u tnT 

13. Sau 2 tuan 1e, cay gan ciic so'cao 8 phan va cay xa ciia sd^cao 5 phan. Oieu nay chJng 
minh cho giai thuyet nao 7 

A. Giai thuyk I 

B. Giai thuybt II 

C. Ca hai giai thuyet 

0. Khong chUng minh chc giai thuybt nao ca 

14. Nhiihg la cay cua cay gan ciia so nho hdn nhUng 16 cay cua cay xa cda so. -Diem nay 
chiing minh cho giai thuyet nao 7 

A. Giai thuyet I 

B. Giai thuy'it II 

C. Ca hai giai thuyet 

D. Khdng chung minh cho giai thuyet nao ca 

15. Ca hai cay Qiu c6 nhiing cham nho mau vang du'di nhiing la cay. -Oie'u nay chung minh 
cho giai thuyet nao 7 

A. Giai thuyit I 

B. Giai thuy'dt II 

C. Ca hai giai thuyit 

D. Khdng chJng minh cho giai thuy§t nao ca 

16. Sau thdi glan 10 tua'n. ca hai cay Olu ffiidc ch^t tan gbc, nJa^sach va flem can. Cay gan 
cula sd n^ng 15 grams, va cay xa cJa so nang 1 1 grams. -Dieu nay chung minh cho giai 
thuybt nao 7 

A. Giai thuygt I 

B. Giai thuyk II 

C. Ca hai giai thuyk 

O 0. Khdng chiing minh cho giai thuydt nao ca 
EWC -5- ^^^i 



17. Tom mu6n thi nghtfim xem phan Don c6 lam cho cSy cbi mpc t6t hdn hay khdng. Anh 
ta nghT ra 3 in'i nghiSm kh6c nhau: 



Thi nohiem *1: b6 pha'^ bon vac 1 chau flat 
va gieo 3 hat adu vao chau. SSn soc ca 3 
cay nhJ nhau va guan sat sii phat tnen 

Thi nghiem *2: Lay 2 ch$u flat va bo phan 
bon vdo ca 2 chau. Giae 3 hat Oau vao 
mol chau. Chfm soc 2 ch^u nhti nhau va 
quan sat sJ phat then. 

Th/nghifim *3: Lfiy 2 chdu CTM, bo phin 
vao chl' 1 ch^u. Gieo 3 hat CTqu vao mol 
ch$u. ch5m sdc 2 chdu nhd nhau v6 quan 
sat sU phat trlln. 

Tht nghi^m ndo chi/ng minh ph6n b6n la tfl't cho ciy cdl ? 

A. Th{nghl6m *l 

B. Th/nghiem *2 

C. Th/nghi§m*3 , 

0 Khdng cd thi nghigm nao chiing minh phdn b5n tot cho cdy 



\ / 



GO PtAr 





18. Tanya mufln bi6t loai dfit nao tdt flfi'trdng cay td ^^'il glflng. C6 ta bo fldt vao chau 
thO nhdt, bo c6t vdo chdu thd hai. vd bo fffit^s6t sdo chiu thijl ba. ^Sou flb c6 ta gieo 
3 hat dfiu vao mfii ch^u. C6 ta 3$t 3 chau k§ b6n nhau gan cda sd'va td6i nU6c vao 
mdi chau Jdng Odu. 



£)dt 



^5' 

cac 



Oat set 



C3y aiu ph6t tnfin tOt nh^t trong chiu ad't. Tai sao bd Jackson bao rfing thi nghiSm 
nay khong phal la thi nghlem tot vd khong chdhg minh ad.dc r5ng cay col phat trieh tot 
trong oat ? 

E. Ciy trong 1 ch^u cb thd'aubc nhlSu anh sang hdn cdy d ch^u khac 

F. 1 chau nen flat dd^l anh 9^n dl^n 

G. Hoc sinh nen thif nhdnj I091 hat giong khac 

H. Sd'lU6ng 9at trong mdl ch^u khong dSng Qeu 

-6- 
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GOC DUdNG TAP NAP 



Hdu hfit hoc sinh 31^ bfi flSn tnJbng Franklin, vd hp phai Ding que QUdng tal g6c dUbng Lin- 
coln Avenue va au6ng Broadway. "Day la ! ng8 tJrSt ffdng xe cO v6i nhieu xe chay nhanh 
v6 khfing c6 den liiu thing hoJc bang hieu ngilng. n$c du c6 ngU6i hJdng dan hoc sinh qua 
diidng, CO ta sd rSng se c6 tai nan trSm trpng x8y ra. 

19. vao mot bu6i sang, Idp hoc cua ba Carter ban thio ve van fle tren. Hoc sinh hbi nhieu 
cdu hoi. CAu hoi nao md em nghl id quan trgng nh^t ffd'giat quygt vdn d3 tr$n 

A. NgU6i cflng 16 vl6n 1am vl$c vdo luc ndo ? 
6. Ai dUdc quyen liu tiin, ngJdi lai xe hotfc ngU6i di bO ? 
C. Oen ffo. vang va xanh cua a6n lUu thdng c6 nghfa gf ? 
0. Lam th§ nao d§' ngS tii dd.dc an toan hdn ? 



20. Ho quygt dinh ph^l 1am 1 chuy^n g] dd'glol quy^t v^n 96*. Trong nhUng d1§m sau 9dy, 
Jidm ndo Id quan trpng nhdt phol 1dm ? 

A. Tdt ca phu huynh chef con em d1 hpc 

6. ygu cau t5ng thdm nhdn vidn cdng 10 

C. Tim each ngin chdn nhiing xe chay qua td(c dO 

0. Tim xem zt bao nhidu hoc sinh 1o s0 vd'vdn dS* ndy. 

21. CO mot nhdm mudn bi^t thdl glan cdn thidt QS' bang qua dildng. Ho phat lojtthg nao (3§ 
blet ? 

A. Dung thUdc d§ do ch1§u ngang cua con QUdr.g 

B. Dung ddhg hd'dd'do thdl glan xe chay ngang qua diidng^ 

C. Dung ddng ho d§'9o thdi glan hpc sinh d1 ngang qua ClUdng. 

D. Nhdn xem hoc sinh nao bSng qua d'UPng nhanh nh'dt. 

22. Carlos va Fred quydt dinh do thbl qian Lee bfing qua dUdng. Carlos b^o r6ng phai tdn 
8 gidy ddng hd'd^ Lee bffng qua diidng. Trong khi dy, F_red bao rlTng phai tdn 10 gidy 
ddng hd'dd' Lee b5ng qua dJdng. Hp phai 1dm g? bdy gid ? 

Thii lai 1 Idn nila. vifi dflng h5 mdl 
Thuf lai 1 I6n nJa, dung ddng hd cua th^y g1ao 

ThLi Ipi 1 la'n nJa, ca hai bSt ddli ddng h^ khi Lee bUdc chdn xud'ng mat dddng va 
ng(ihg ddng hd khi Lee bd'dc chdn idn 1^ dUdng phia bdn kia. 
ThiJ I91 1 Idn nUa. nhJng Idn nay bao Lee phai chay tJld~D6n nay qua IS ben kia 
trong vdng 8 gidy ddng hdT 

4f^3 



23. C«rloe ¥• Fred do thdi gi«n 66 bfng qua W6ng cu« tit e« hoc einh. Va thdi glen 
trung &1nh a§ DSng qua ffobng la 11 giay. Em c6 Oe nghi gi «*lam cho van Ue bSng 
qua JUdng mc an loan hbn ? 

A. -05t mti Qen IQu th6ng va ctf rniti 2 phiit thl chen xe lai trong vong 11 gidy 

B. Oit nnOt Qen lUu th6ng va cii nn6i 2 phiit thf chan xe lei troi.g vong 15 giay 

C. Day cho tSt ca nrigi ngJdi bang qua ffUftng trong khoang thd'i gian I't hdn 1 1 
gidy 

D. Nhan v'en Cong 1$ ffg'ngUng xe eg li/u thong mfi 1 1 giiy. 

24 Hpc sinh trong Idp cue ba Carter lam mot ban tiibng thuat v§ nhUng dieu ho Qa nghv 
en cUu. Ban tdbng thuat ay bao gdm nhJng 9e nghi di/a tren nhUng duf kien thau thep 
ffU.6c. Em nghT hp se lam gi ? 

E. Xin phep Qe'thdng bao vdi nhUng hoc sinh khac trong tnlbng Franklin ve dJ an cue 
ho. , 

F. Yeu cau ba Carter cho fllim cho nhUng hqc sin**, OB lam vi$c trong dii an tren 

G. Veu cau Hi|u trubng cung cSp nhdng vat dung va xay mdt Qen lUu thdng 

H. Mdi mgt ngddi nao Q6 tJ sd ca'nh sat 7§n ffg'nghe ve ban tiTdng thuat cua ho. 



lam ti§p trang ten 



I 
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BAN NHi^T-DQ CUA PHONG HOC 



Ldp hpc ciJQ 6ng DaCosto lorn m$t bon^tUbn^ thu$t nhl^t 06 trong vq ngooi phong hoc 
m6i gicf trong mOt ngoy muo Thu. Nhdng dU kifn cuo hp nhO sou: 



Nhl^t Oo b^g 06 F*vdo ngay 1 thong 10 



8 a.m. 9 a.m. 10 a.m. 11a.m. 12 noon 1 p.m. 2 p.m. 3 p.m 

Trong phong 62* 71' 80' 75* 72* 74* 75* 72* 
Ngoai phong 61* 65* 68* 72* 78 * 82* 79' 75* 



Dung nhUng dii klen trong bon trdn. tro 161 cdu hoi 25 96'n 31 

25. Luc may gid th? phdng hQc qua lanh ? 

A. 8 a.m. 
8. 9 a.m. 

C. 1 p.m. 

D. 3 p.m. 

26. Luc mdy gid thfcan phal mh cUa so Se phong hoc ClOdc de chiu 

E. 8 a.m. 
F 9 a.m. 

G. 10 a.m. 

H. 12 noon 

27 Khoaiig thd'i glan nio thF nhiSt fl6 ben ngoai t5ng nhifu nt\h 7 

A. GIiIb 8 a.m. va 9 a.m. 
8. GiJa 9 a.m. va 10 a.m. 
C. GiJa 1 1 a.m. va 12 a.m. 
0. GiiJa noon va 1 p.m. 
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29. Voo mat ngey nhd v$y, luc noo thi" hoc sinh nen moc ao om ? 

E. Chi vao budi sang 

F. ch{ vao budi true ^ 

6. nguy§n ngay nd'u ngoal ph6ng 
H. nguyen ngdy neu 6 trong phdng 

29 Neu m6t hoc sinh m5c ao am Hi den 16p, vao khoang gid n6o th" hoc sinh ay se mu6n 
. cdi ao am ra 

A. giJa 9 a.m. va 10 a.m. 

B. gii^ 10 a.m. vfi 1 1 a.m. 

C. giiJa 10 a.m. va 12 noon 
0. giJo 2 p.m. va 3 p.m. 

30. Luc neo thT nhi^t 96 bSn trong va ngoai phong khac nhau nhleu nhat 



E. 9 a.m. 

F. 10 a.m. 

G. 12 noon 

H. 1 p.m. 



31. Hal nhiet 06 k§' ve ben dJ6l day chi nhi^t 96 ben trong va ngoai phong vao luc may 
gid ? 



A 9 a.m. 

B 1 1 a.m. 

C. 2 p.m. 

D. 3 p.m. 



nhi«t gp ke trong phong 



nhift 96 ke ngMi phong 



- 90 




- 90 


-80 




-80 


-70 




-70 


-60 




-60 
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APPENDIX D.1 



NOTES ON COLLABORATIVE RESEARCH 
or 

"Shall We Dance?' 
by Margaret W. Plum 

how Did You Do It? 

"How did you do it?", asked a teacher union official, in an aside to the Principal 
Investigator who had just reported some preliminary research findings at a '^^ston 
Compact Meeting Expressing surprise at the degree of cooperation represented by 
the amount and the quality of the data just reported to him and others at the meeting, 
he wondered aloud: "How did you get the teachers to do it?" 

In his question, the union man showed a dawning appreciaiion of the three- 
year effort, calculating the price of a collaborative effort witn the Boston Public 
Schools. He could only guess at the number of phone cpJis (returned and not 
returned), the letters and memos, the site visits, the meetings and appointments. He 
could appreciate the scheduling and rescheduling, the writing, the reporting, copying, 
collating, and stapling. He understood the anount of time, paiience, tact, compromise, 
enthusiasm and constancy needed for the task. 

Answering the quec-ion, the Principal Investigator nodded toward the Project 
Coordinator who was seated across the table and said, "It's because of her". Th9 
answer, while overiy sim.plistic (and c<?rtainly understandable given the context of a 
side converSvition at an ongoing meeting) indicates the importance of the single- 
minded, dedicated effort of an individual or Individuals to a collaboration. Wynn De 
Bevoise in Collaboration: Some Principles of Bridgewori< quotes Randall Power3. 
former dean of Louisville's School of Education- "In the end, collaboration depends on 
people o \ both sides being willing to make it woric. You can have as elaborate a 
mechanism as you like, but that woni cany things through. It's the people that matter". 
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It's the People That Matter 



The people who started the collaboration were Dr. Mary Shann, the Principal 
Investigator; Dr. Robert Sperber, Director of the Boston Higher Education Consortium: 
and Ms. Diana Lam, then Area Superintendent for District A of the Boston Public 
Schools (now Superintendent of the Chelsea School District) who met for the first 
time in January. 1988. Why District A? Boston University had had a 14-year history 
with the District A of the Boston Public Schools. Ushered in as part of the court 
ordered desegration plan, the pairing linked Boston University with the schools in 
Bnghton-Allston, Roxbury, and Jamaica Plain, then, as now, poor minority 
neighborhoods, with increasingly diverse ethnic minorities and languages 
represented. District A also provided the variance needed for the research. It was a 
na\jral partncir in this collaborative research effort. 

Prior to this initial meeting. Dr. Shann had formed a committee of senior 
advisors and interested graduate students. The advisors were chosen because of 
their specific areas of expertise. They were Dr. Sperber; Dr. Don Davies, Boston 
University Professor and President of the Institute for Responsive Education who is an 
authority on parent involvemc. t in schools; Dr. Kevin Ryan, Boston University 
Professor and authority on moral education in schools; Dr. Kay Coleman, a specialist 
in measurement and research, and Dr. Joseph Cronin, President of Massachusetts 
Higher Education Assistance Corporation, and adjunct faculty member at Boston 
University School of Education. Dr. Sharon Hennessey, Principal, Wayland Senior 
High School, joined the advisory board in the second year of the project. 

The original group of graduate students included Mary Williams, Margaret Plum, 
Jean Krasnow, Anna Wong. Tom Bartlett, Sue Waiter, and David Greenhalgh. The 
committee met several timos during the summer and fall of 1987 to shape and define 
the school effectiveness research project in middle schools, 't was determined that the 
purpose of the research would be to define and validate indicators of effective middle 
scho Ms other than basic test scores; specifically, prosocial skills indicators and 
indicators of higher ordor thinking skills. It was also determined that' the research must 
be a fully collaborative effort with the Boston Public Schools to bo successful. By fully 
collabcrative, the committee meant involving the participating schools in every stage of 
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the research - the planning, the instrument construction, the administration of the 
instruments and data collection, the analysis of the data and tne reporting process. 

So it was with this open-handed attitude and collaborative spirit that Dr. Shann 
and Dr. Sperber met Superintendent Lam. Diana Lam was very receptive, very 
cordial, and very down to business. Having heard that we had three points to make, 
she wanted to acknowledge each one. She wanted the best for her schools-students, 
teachers, and administrators alike-and if we had a sound idea, she would ask her 
people to cooperate. 



Getting the Schools to Dance 

"Collaboration starts with administrative support." DeBevoise(1986) quoting 
Terry Brooks, formerly a middle school principal for the Jefferson County Public 
Schools and currently the director for middle schools programs, says," [In the school 
system] the superintendent's priorities get canlod out; they are supported by teachers 
and principals. But beyond that, when the superintendent places a high value on 
collaboration with the university, it's easier for individuals to get support from the 
district-level staff for such projects." 

After Supt. Lam had advised the principals to expect a call from the research 
team, appointments were arranged with the principals of the four middle schools in 
District A by the research coordinator. The interviews took place at the end of March, 
fui.y twc months after the initial meeting with Supt. Lam. Scheduling nr:detings was to 
become a significant, ongoing problem and required many phone calls, confirming 
letters, follow-up phone calls, reconfirming letters and patience. University academic 
schedules are different from public school days. Testing, reporting, and vacation 
schedules differ. Delays between plans and execution would become the norm rather 
than the exception as the two institutions began to understand the rhythms of their 
lives. The rhythms are different and each institution dances to a different beat. 
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Assumptions About the Dance Program 

Assumption #1: Because we are both educational institutions, we 
are similar, share the same goals, ani speak the same language; 
therefore, collaboration and coordination will be smooth and easily 
achieved. 

The average person who is not part of the public schools or the 
various institutions of higher education in this country probably has the 
commonsense point of view that these organizations are in the same 
business--education--and assumes that they work together to achieve 
complementary if not identical goals. The average person would 
undoubtedly be surprised if told that, in reality, these are very different 
kinds of organizations with cultures so different that professionals 
working with them have difficulty understanding on another's needs and 
values. Since all professionals in schools and universities have at one 
time or another been active participants in precollegiate education-as 
students if not as faculty or administrators-- it is even more surprising that 
these people have a lack of knowledge of each other's culture and a lack 
of awareness of how they can work together to achieve more than can be 
accomplished by working separately. In spite of commonsense points of 
view and lack of knowledge about each other's institutions, collaboration 
among school and university personnel is now one of the most frequent'y 
talked about approaches to the reform of education." (Clark,l988) 

In spite of commonsense points of view and lack of knowledge about each other's 
institutions, the research collaboration between Boston University and the middle 
schools of District A, Boston Public Schools began. 

The First Principal 

Armed with a verbal proposal of the research, two open-ended questions, and 
enthusiasm, the Principal Investigator and Project Coordinator met the first principal. 
The plan was to make a brief general statement of the research proposal in order to 
inform but more importantly to illicit suggestions and support for the project. The 
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questions to be asked were: 1. What factors do you see present in an effective school? 
What factors do you see in your school that promote effectiveness? Why do you think 
these factors contribute to your school's effectiveness? Give examples. 2. What factors 
do you see that hinder your school's effectiveness? Why? Give examples. 

While the statement was designed to be brief and the questions few, our 
enthusiasm was abundant. It was assumed the schools would be enthusiastic too. 
They would be eager to participate in our middle school research. 

Assumption #2: The Schools will be eager to work with us. 

To say the first principal was underwhelmed to see us and hear about the 
research proposal would be an understatement. While he was cordial, he made it 
clear he had seen many research projects. This school has hosted lots of research 
teams. We have been the subject of Channel 4 news. We're used to visitors." 
Understandsbly, he was reluctant to have another research intervention and intajsion. 
What good is research he implied as he talked about the death of the urban public 
school systems in the next 10 years. Rrst New Yorit, then Chicago, then Boston, he 
prophesied "Schools are caught in the cycle ~ low paying jobs leads to low standard 
of living leads to poor education leads to low paying jobs and round and round it goes. 
How do we break the cycle? What's happening is central administration is interested 
in short term plans and the situation calls for long range planning. The 
Superintendent (Laval Wilson) is measured by short term miracles." As this picture of 
the situation was developed, our enthusiasm began to sag. Assumptions about this 
research collaboration had to be revisited . 

It had been assumed (by the Project Coordinator, if not the Principal 
Investigator, who had done research in urban the schools one and two decades 
before) the schools would be eagsr tc participate in this middle school research 
because: (1) so little research had been done in middle schools, (2) as professional 
educators, thoy would want to add to the knowledge about middle schools, (3) tliey 
would want to wori< with Boston University, (4) the Boston Public Schools need help, 
and (4) the amount of the current local and national attention focused on the decline 
of public schools created a sense of urgency and priority. 
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The Realities 



The principal was bringing his realities into focus. Research Is intrusive in the 
school day. Research places additional demands on administration and teachers. 
Researchers come, get their data, and leave. What do the schools get out of it? Often, 
not ^ven the final report. "University consultants often come into the schools to sell 
their ideas and leave, just when the going gets tough. The school people are then 
expected to take the heat" (Oe Bevoise). 

The principal continued," The pressures to raise reading scores are enormous. 
Boston schools effectiveness measures are too limited - just test scores - which leads 
to this pressure". The PI heartily agreed saying that it was exactly this that had led to 
the idea of the development of additional measures. The principal guardedly agreed 
to support the project and selected his Director of Instruction to be our "point person" in 
his school. 



The Second Principal Inten/iew 

At this schoo!, it was more a conference than an interview. This principal 
included her Asst. Principal and a teacher, the school's teacher union representative 
to discuss the project. After the group heard the proposal, the teacher spoke first. 
"What's in it for us? We are constantly being researched and then we hear nothing. 
We get nothing out of it." She had come prepared to correct this oversight anc^ 
strongly offered these requests/demands to BU: opportunity for free courses at BU. 
addition of "research assistant" to teacher resumes, use of BU education professionals 
in appropriate ways. 

The principal spoke next and explained that her school was already 
participating in another research project on At Risk Youth and wanted to join the two 
reseaich efforts together to conserve the time and energies of herself, her staff and the 
students. She wanted the data to be shared. She also had prepared with a list of 
requests tor BU: a calendar of relevant seminars, notices of School Effect;. -eness 
workshops and infomiation on school-based management courses. She made some 
positive suggestions for the research study: (1) translate the questionnaire into 
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Spanish. (2) find a way to make the student questionnaire anonymous and yet coded 
sc that student test scores can be matched with questionnaires. Information must be 
kept confidential. They asked for copies cf the questionnaires and were tokj that as 
part of a fully collaborative research project, each of the participating schools would 
participate in the design of the instruments. It was agreed the university team would 
make the initial drafts to be submitted to the schools for suggestions. 

Another Reality: Research is not a top priority in the public schools. 

By the second interview, it was clear the schools were following instructions to 
participate in this research project but with many reservations. It was not JOB 1 . As 
long as they had to participate, the schools were going to get as much out o^ the 
"collaboratioir as they gave. 

The Third Principal Inten/iew 

The principal, after hearing the proposal, launched into a hynnn of praise for his 
school. "We are the flagship of the middle schools. Our population is & little UN. We 
have Vietnamese, Chinese, Japanese, Black, Hispanic, Russian - it's a good mix. 
Students bring their cultural attitudes about education for home. Educciiion is a top 
value for some (Orientals), socializing for others (Blacks and Hispanics). Here 
different values come together, mix and influence across cultures", he said. He was 
intrigued with the values content of the research and enthusiastic about the focus on 
middle schools. He agreed to support the research and to let us administer the 
questionnaires in his school 

Then came, "What's in it for us?" He wanted opportunities for BU courses, 
addition of "Research Asst." to teacher resumes, use of BU video taping equipment, 
Mastery Learning Lab assistants, and a BU graduate studert to read books from a 
. prepared book list in order to prepare questions. 
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Still Another Reality 



The list of requests for resources from Boston University was growing. What 
requests were possible? appropriate? and who was going to investigate and follow 
through on these requests? 

There is more to collaborative research than the research goal. 

Interview with the Fourth Principal 

"Why was our school picked?" asked the principal and was told of Boston 
University's 14-year history wth District A. That, however, was only part of the story. 
WIthifi District A, his school and another were considered less effective by virtue of 
their Metropolitan Achievement Test scores, while the other two were considered more 
effective by the same measure. The differences among the schools would provide the 
range of variance needed for the study. 

"Don't compare city middle schools to suburban schools. This is unfair. It's 
unfair to compare our school to other middle schools. Look at our school as unique 
and individual. This school is a safe place where students can interact. We are taking 
over the job formerly done by churche<«, the government, sodai agencies, and the 
home. Our school has leplaced home. It's a pleasanter place to be that home for 
many of the students." 

The principal's most important issue with this research was how the data vnuld 
be used, how and to whom would the findings be reported. T^e research was 
discussed with special emphasis on reporting procedures. He was assured that each 
school woukJ receive statistical analyses of its own school and a composite analysis of 
all schools. The application implications of tt a data collected in the teacher and 
student questionnaire were, for him, future staff development opportunities and 
enhanced service to the students . 
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"Schools are being asked too much • to be a social center, medical center and 
education center. These are ranked differently by different groups. Students' needs 
reflect a social, medical, educational ranking. School Administration wants an 
educational, social, medical ranking." The principal became very supportive of the 
study because of its focus on development of additional measures of school 
effectiveness. He agreed to (1) distribute Teacher Questionnaire on April 4 and (2) 
discuss research with the teachers on April 8 at Inservice Day. He suggested (1) some 
student questionnaires be administered orally as man/ students wouW not understand 
the questions unless they were read aloud and (2) some introduction and preparation 
for the questionnaires be given to teachers and students so the questionnaires would 
not be taken as a joke. 

The Collaboration Had Begun 

The University team had visited the schools, met the principals, described the 
research idea, heard the principals' concerns, pinned down a few dates and collected 
several useful suggestions for collecting the data. In the next week, the Directors of 
Instruction in each school would be selected as the "point persons" to coordinate and 
facilitate the first round of data collection - the administration of the teacher 
questionnaires and teacher interviews. 

More Reality 

It was immediately apparent that there were significant differences among the 
four sC'^'ools and collaboration would have to be tailored to each schools' needs. 
While they were all middle schools within a district of the Boston Public School system 
and their schedules were similar, they differed widely in management, personnel, size, 
and climate. Rather than a single collaboratior., there had to be four uniquely 
individual collaborations. 

The 1988 Teacher Questionnaire 

The Project Coordinator met with each Director of Instruction individually to plan 
tht» method of administration of the Teacher School Climate Questionnaire. They all 
agreed that, in order to get a good return from the teachers, the questionnaire should 
be completed by the teachers while at the school in groups rather than distributing 
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them for completion at home. Each school wanted a different method of administration. 
One school chose to have it administered by two members of the university team at 
their April 8 Inservice Day . Two schools had the questionnaires administered at one of 
the schools' regularly scheduled April cluster meetings. As each school had six 
clusters, this required at least six members of the university team to be available for 
on-site visits on two days. The principal of the fouth school was finally able to 
organize a teachers' meeting in May. Two researchers introduced the study and 
administered the questionnaires. 

Meanwhile, plans for selected teacher interviews were being made 
simultaneously. The schools were asked to select 9 teachers - 3 from each grade with 
varying years of experience, ethnic bacltgrounds, and of different sexes. Once again, 
the schools responded differently. Some were selected uy the Directors of Instmction, 
some by the principal. At this point, the sc 'ool secretariec began to play a significant 
role. Each teacher's schedule (free period) and phone number was needed to 
schedule the interview at the teacher's, the school's, and the interviewer's 
convenience. The school sacretaries were the key to this process. By now, the 
research coordinator had met each secretary, memorized their names and knew 
something about the rhythms of their school day - when to call, when not to call. In all, 
36 teachers were assigned to university research interviewers who made their own 
appointments, which were arranged on an individual basis by phone, by letter, and 
sometimes even by personal visit. 

Building Relationships 

The collaboration was growing. More and more people were becoming 
involved. By now, four principals, four Directors of Instmction, 175 teachers, four 
school secretaries, and six university researchers were interacting at some level. 
Each time a person from the university met a person from the schools the collaboration 
changed. At this stage in the development of a collaborative effort, it was critical that 
each interaction be unhurried, thoughtful, and considerate under any circumstances. 
It was especially critical in the Spring of 1988. The "Rites of Spring" in the Boston 
Public Schools feature the teachers waiting to hear if there will be school layoffs and 
who will be laid off. The Metropolitan Achievement Tests in Reading and Math along 
with batteries of other tests are given in the spring. The pressures to "bring the test 
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scores up' juxtaposed with 'will I be teaching next year" create an atmosphere that is 
fraught with tension. It was against this backdrop that initial data collection with the 
teachers began. 

Teacher Data Collection 

The administration of the questionnaires was the first time most of the teachers 
had heard about this school effectiveness research study. The members of the 
research team introduced the research clearly, encouraging any and all questions and 
comments from the participants. It was important the teachers understood not only the 
nature of the project but the level of commitment to collaboration that was beii.g 
sought. The teachers' first impressions, while not wildly enthusiastic, were positive. 
Fully 135 of the 175 teach-^rs completed the Teacher School Climate Questionnaire. 
Because of or despite the sp.'ng circumstances, the teachers had a lot to say and were 
willing to say it. 

The teacher interviews were a.'anged in May and June. Again, most teachers 
made every effort to meet the interviewer and respond openly to the questions. Thirty- 
two of the 36 interviews were held as scheduled. 

School Research Teams 

Because of the award of the research grant by the U.S. Department of 
Education in August of 1988, the university team was able tc continue to build the 
collaboration. The grant provided a stipend of $500 for each of the four teachers who 
would comprise the school research teams from each of the four schools. Also 
budgeted was money for two late afternoon/dinner meetings (to be known as the 
Castle Meetings) for the full research team, university and school members. 

The school principals were asked to select the four teachers who would serve 
on the school research teams with the principals and the Directors of Instruction. In 
one school, the principal alone selected the four people. In two schools, the principal 
selected the teachers with the help of the Directors of instmction. 'n the fourth school, 
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the Director of Instruction announced the plan, asked for volunteers, and selected from 
those interested. 

The responsibilities of the school research teams were: to attend the two full 
research team meetings; and to participate in the development, the administration, and 
the analysis of the Student School Climate Questionnaires and the Test of Problem 
Solving instrument. 

The First General Meeting at the University "Castle" 

Prior to the first Castle Meeting in January, 1989, each member of the school 
research teams received a copy of the agenda, a list of the participants with brief 
biographies, a summary of work done to date, a copy of the draft of the Student School 
Climate Questionnaire, and passes to a conveniently located partying garage. The 
objectives of the meeting were: (1 ) to get to know each other; (2) to leam more about 
the research project; and (3) to revise the draft of the student questionnaire. 

Each participant was greeted at the door of The Castle by fie research 
coordinator (a person everyone knew) and given a color coded name tag, designating 
the table seating at the meeting. It was a deliberate effort to mix the university and 
school participants. This was marginally successful. It soon became clear that many 
members of the group felt more comfortable sitting with people they already knew. 
Comfort won out as it should have at this initial meeting. 

The meeting began at 3:30 p.m. with a welcome from the Dean of School of 
Education. The Principal Investigator, known to most of the participants, welcomed the 
group and asked each school spokesperson (who had been chosen by their g'oup 
earlier) to give an introduction to his school and introduce the school's members, ".'he 
Senior Advisors were introduced. The Principal Investigator introduced the day's work 
by saying, "Today is a working meeting but also a celebration of our collaborative 
efforts toward improving education for at risk .students. This meeting is possible 
because of a grant for the U.S. Department of Education. Only eight proposals were 
successful in an intense competition that received more than 200 applications." The 
first reason she gave for the award was the collaborative nature of the design. She 
said, "It joins un( 'ersity based people with practitioners in the field, starting at the 
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planning stage. We listened hard when we met with you last Spring and we 
incorporated many of your wants and needs into the design. We will continue seeking 
your advice as we proceed. It's especially important that you give us insights on how 
to make the results useful to teachers and other school-based personnel." She 
continued with the additional reasons and segued into what we have done and 
learned. She then asked each table to work on the Student Questionnaire, 
requesting that ^ach group examine the content ("Are we asking the right questions?") 
and develop a plan for administration of the instrument. 

The groups reported their suggestions to the full group. Among them were: 
additional questions, changes in terminology, and simplifications of words. They 
untangled the problem of confidentiality. Each booklet would have student's name 
and identification number. After distribution to the student, the teacher would asK the 
student to black out his/her name leaving the ID number to be coded when the data 
was processed onto the data tapes. This was an . 'portant issue because the 
student's questionnaire responses needed to be analyzed with his/'^er test data from 
the Boston Public Schools for the purposes of the study. 

Dates in March, 1 989 were scheduled for administration. It was decided the 
homeroom teachers would give the questionnaire with university researchers at tne 
site to answer questions. Questioi.iaires would be printed in English, Spanish and 
Vietnamese and delivered to the schools a week prior to administration. The school 
team members would be responsible for delivaring the surveys to the individual 
homerooms and collecting them after completion. Homeroom period would be 
extended on the day of data collection. The myriad of details involved in the 
administration of the student questionnaires was falling into place. 

The Collaboration Grew 

The day and the task had built another bridge between the two collaborating 
research groups. University and school educators had come together and 
accomplished something together. There was a good feeling as the participants went 
to dinner together. As Goodlad predicted, "Both individual and institutional renewal 
are vastly enhanced when the workplace is continuously infused with both the 
craftsmanship of those similarly engaged and relevant knowledge from both inside 
and outside the setting". 
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Other benefits accrue from the collaborative research phenomenon. 
"Ueberman (1986a), for example, focuses on teams of school and university people 
created to engage in research and development and six benefits that can come from 
such teams: 

-Collaborative research and development creates a structure for teachers that 
facilitates "eflection and action on the messiness of teaching and schooling problems. 

-The team unites teachers and encourages collegial interaction. 

-Both the process of group interaction and the content of what is learned narrow 
the gap between "doing research" and "implementing research findings" 

-Naturally occurring problems that teachers have in their schools may lend 
themselves better to this type of research and development than large-scale funded 
research, as it can respect the time lines of the school people rather than the research 
grant. 

-A collaborative team provides possibilities for teachers to assume new roles 
and exhibit Idadership. 

-Collaborative reseacch legitimates teachers' practical understanding and their 
definition of problems for both research and professional development." (Clark) 

Collecting the Student Data 

In March, 1989 the teachers in the four schools administered the Student 
School Climate Survey. Data collection went smoothly and 1583 of the total 
population of pbout 1800 students completed questionnaires, approximating the 
average daily attendance for the four schools. 

In May, 1132 students completed the Test of Problem Solving (TOPS). The 
schools suggested the smaller sample might have been due to lower attendance on 
the day of test administration. However much of the attrition could be explained by a 
change in the permission procedure in one of larger schools. The principal elected to 
send parental permission r.lips home to be signed by the parents if they would permit 
their student to take the TOPS. (Heretofore, the permission slips were to be returned it 
the parents d'd not want their students to take the test.) Of the 1 1 32 returns, only 972 
were usable. The teachers in the smallest school complained that the new test was 
too hard for their students and that there was already too much testing goi:ig on That 
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school's low rate of usable returns accounted for most of the additional loss of data for 
TOPS. 

The Second Teacher Climate Questionnaire, 1989 

In May, the second Teacher Questionnaire was administered. The school 
research teams were responsible for distribution and collection from the teachers ir. 
their schools. Only 92 teachers responded with usable returns (in contrast to the 
sample of 135 in 1988). An additional 14 teachers in one school received the 
previous years' form of the questionnaire and their responses could not be counted. 
Two schools reported, because the questionnaires were anonymous, it was difficult for 
the teams to determine which teachers had returned their questionnaires and who had 
not. Their rates of response were 29 down from 55 and 14 down from 31. Clearly 
there were other factors operating in these two schools. May is not a happy time for 
Boston Public School teachers; however, the other two schools were able to do the 
job. The third school's response ^vas 23, down only two from 25, and the fourth school 
showed an increased response, 26 up from 24. 



The Second Castle Meeting, June 1989 

In attendance at the June Castle Meeting were the four school research teams, 
the Principal Investigator, the Project Coordinator, and university research team, 
including the faculty advisors and the graduate student participants. Prior to the 
meeting, each member had received copies of the list of participants and the agenda. 
Each school team had met separately with the Principal Investigator and the Project 
Coordinator at the school to preview and analyze its student data. The task this day. 
after a brief overview of the project, was to review the frequency data of the student 
questionnaires. Each team, seated at separate tables by school, was asked to select 
several areas, identified by the research, that they wished to celebrate and those 
areas they wished to improve. They were asked to determine ways to communicate 
these findings to their several audiences - the rest of the school's faculty, the students, 
the parents, the community. The wori< session ended with a free exchange of Ideas on 
use of the research information and ways to communicate the findings. The 
atmosphere was open. The collaboration had gathered momentum just as the two 
institutions prepared for their summer schedules. 
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Fall of 1989/Winter of 1990 



Relationships with the schools were maintained. Individual lunch meetings with 
Principals and Directors of Instruction from the four schools were held to discuss 
analysis of the data of each individual school in preparation for final reporting. Each 
school has been kept informed about the progress of the project. It was hoped that, 
while the continuation of the project "Translating Research into Practice for Effective 
Middle Schools" did not receive funding, this established collaboration ccould provide 
ongoing support and help in improved practice in these four schools through this 
research information. Specific plans included a presentation to all the Directors of 
Instructions of Middle Schools in the system, which was given in April, 1S90, 
presentations to the individual schools' teachers on inservice days, and informal help 
to individual principals as they build their schooNbased management teams. 

"Collaboration is not an automatic virtue. Not every cooperative venture is 
destined for success. But to those who make the effort and occasionally, succeed, the 
rewards are high and students are well served. There can be no better reason for 
working logether" (Maeroff, 1984). 

Clark, Richa'd W. (1988). School-University Relationships :An Interpretive Review. 
School-University Partnerships in Action, Sirotnik,K.A.,& Goodlad, John I., 
editor. New YorkTeachers College Press. 

DeBevoise, Wynn (1988). Collaboration :Some Principals of Bridgewoh^. Educational 
Leadership, Vol. 43, No. 5, 9-12. 

Maeroff, Gene 1.(1984). School and College Partnerships in Education. Princeton, N.J.: 
The Carnegie Foundation for the Advancement of Teaching. 
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APPENDIX D.2 



Newsletter to Participants in 
Collaborative Research for Effective Middle Schools: 
Boston University School of Education and the Boston Public ScKk>o1s District A 



April, 1989 



To: Ail Administrators, Teachers and StafT 

From: Dr. Mary H. Shann, Project Director, on Behalf of All of the Boston University Research Team 



Thank you for your help and support in this effort to learn more about nnaidr)g urban middle schools more 
effective, especially for disadvanteQed youttt We appreciate your continued Interest and enthusiastic 
cooperation as we proceed with ti>e date collection for the research. You will be Informed of tfie resuKs as 
tiiey become available. This news letter Is intended to keep you informed about the progress of the study 
to date. 

A great deal of activity has been underway throughout the course of this study, but we provide that 
information in a chronology of events at the end of the letter. Most of you want to know the resuKs. Here 
are preliminary findings from analysis of the teacher date which was collected in May and June. 1988. 

The design of tiie interviews with teachers was to Inquire first about what you iiked teaching in your 
school, and second, what you would change. As we listened to you. reread your words, and discussed 
the resutte among the team of interviewers, certein themes emerged. It is around your themes that the 
report Is constructed. 

The themes are: with regard to the school-the comphxtty oi daily life, influences on the social climate 
and physical envtronn)ent; with regard to principals-^the balance between strong leadership and the 
sharing of power; with regard to teachers-^ multiple roles which teachers are called to serve, and the 
need for professional recognition and professional development of true professionals; with regard to 
parents-the importarKe you place on their Involvement in the education of their children and how to 
secure it; with regard to sludenta-the great caring teachers and principals have about their charges. 

Resulte on each of the^ themes is summarized below. Much of the infcrrration will be no news to you. It 
simply confirms the insighte of knowledgeable, experierKed educators, but it is important to gather this 
information systematically to persuade legislators and other policy makers, as well as otiier practitioners as 
to what needs to be done to make and maintein effoctive schools. The point is that research is not always 
what we arrive at by 'comnr)on sense.' 



About the Schools: 

Complexity of daily life in urban middle schools ia considerable. 

- There is continual change-in schedules, programs, and staffing. 

- Studente f^equenUy transfer, tt)eir family situations in flux; 

- Innumerable demands are placed on schools to provide a host of human services to students, 
often without commensurate resources. 

- To capture tNs theme in quoteble quotes from teachers: ' Barents wMnt the schools to do ft all. ' 
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- In addition to academics, the children need to learn about living and getting along with each 
other....Our guidance counselor de^ls with 600 kids... Just how much can he do? There is no 
career counseling. They dont have the slightest idea. These kids are teaming social skills on the 
street, and those arent necessarily the right ones. They are missing a lot... We need an active 
health program...lf not us, no orm is teaching these kkls anything from personal hygiene to social 
manrwrs. ' 

The physical environment end social climate of the school has a decided impact 
on how people feel and behave, according to the teachers we interviewed and 
what we observed. 

- The schools are in varying need of maintenance; some are in great disrepair. The needs are not 
just cosmetic, but functional. 

- "Fix up the school: make it a prettier place to come to; do something about the peeling paint-it 
says sometNng about the importance of learning: the plaster fell off that whole section, thankfully 
not on some student's head, but the laths and interior brick are still showing, six months after a 
requisition was filed. ' 

- Many teachers try to mal^e their own rooms more attractive and realty do succjed as brightening 
their environment; 

- Space shapes behavior, e.g.. teacher opportunities to meet in a cornfc^able quiet spot 
influence the kind of interactions which can take place; 

- There will be more about this in forthcoming components of study, especially through the 
stmctured observations of physical spaces and questionnaire responses from students and 
teachers, but one teacher's comments summarized the need to study the ochools' clinfiate: 
'While working on Wilson's new reading program, I had occasion to go to all the Boston middle 
schools. I could sense a particular climate or personality in each sci)ooL I wish I had been more 
objective then and taken notes. ' 



Regarding Teachers* Views of Principals: 

- Teachers liked principals who hold clear, high expectations; 

- Who practice strict, and consistent enforcement of discipline; 

- Who enforce the schedule to promote attention to academics and who limited interruptions to 
classes; 

- Who provide adequate resources to teachers; 

- Who give teachers some say in decision making; 

- Note there is a delicate balance between strong leadershio and the sharing ol 
power with teachers; 

- The research has been noting for some time th:i importance of the principal's leadership but the 
research is less clear on how the principal how the principals accomplish these things; this is 
what were after: Several quotes and anecdotes are reported here to specify how leadership is 
portrayed. However, the pronouns are arbitrarily and consistently given in the feminine in order 
to honor our commitmant to anonymity. 

- 'Ate. X is very supportive of the bilingual. She wanted the kids, fought for the new teachers she 
needed, and did all the extra work to reschedule the teachers in the middle of the semester ' 

- Another teacher related an anecdote about one bilingual student vi/ho was extremely upset and 
concerned about a serious problem at home. That student choose to seek help from an 
assistant principal, a real compliment to that person, she fett. 

- One teacher seeking a well disciplined school with firmer control, security and safety and 
therefore more opportunity to deal with cun^iculum issues transferred to one of our schools and 
liked the style of his new principal very much: 'Ate. Zis everywhere!' There's very little that gets 
bythat woman" 

- Another teacher: Ms. X has a lot to do with the atmosphere. There's freedom, trust, and a 
respect for the people who work in the building. I dont know how she does it There's method 
to her madness. As a specialist /Ve worked in several bulkllngs In the systems, so I've seen a few 
principals and how bulUlng are mn. Here Its like I died and went to heaven. " 

- More misc. remari^ about good principals: 
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- We QBtM lot of support She's MJways willing to listen to you. If your idee is better, shell change. 

- The school Is well mn. You nrny not //to ell of her decisions, but she is a creative genius, fosters 
productivity In everyone. 

- There's real supervision: the first week she was In my class eight times: never intemjpts: notices 
everything, even ho\f you talk to kUs In the hall." 

- 1 was at a schod where the kkb had Letter home lives but the schod was so poorly mn,^^ 

¥¥as totally demorrjbed, lhadtogetout Ifi much batter here.' 

- She treats teacners as professionals. (Librarians too.. When hired, she was given -.omplete 
latitude In sche^JulIng the use of the library. ) 7 Nred you as a librarian, now be a librarian. ' 

- Tha administrvtton really cares about the teachers and the students here. 



Teachers' Views of Themselves and Fellow Teachers: 

Teachers as Professionals*- 

- Teachers want to be treated like professionals; 

- They want participation In decision mailing; 

- They value colleglailty fostered through cluster programs or other arrangements that give them 
time to collaborate on curricular decisions, share information about individual students; talk about 
professional Issues. 

- Those who had these opportunities credited them as major sources of job satisfaction; those 
who were unhappy with their situations named isolation and the lack of opportunities to work with 
other teachers as things they sorely needed. 

- Teachers valued supervisk)n if it was done constructively. 

* They respected principals who set clear high expectations and then followed through ^ith 
consistent behavior patterns. 

Misc. quotes re what they liked: 

'Cluster system nwats weekly with administrators but is teacher led. 
Teacher relatlonsNps are very good. ' 
'Even as a first year teacher in the buiUing, you have a voice. ' 
'We have frequent discussions of students: they dont get lost ' 

'Ifs not unusual for teachers from this school to give up time on their weekends to help students. 

or to wrk on a special project' 

'All the teachers here are expected to be good teachers. ' 

'Not everyone gets along well, but all in all, the teachers here treat each other with respect ' 
'We all work toward the sanw goal-teaching students the best we can. Teachers can respect 
themselves here because they are treated as professionals, so teachers can also respect each 
other.' 

Teachers as Ooctors/Lawyers/lndian Chiefs— 

* Not only are middle school princlpais supposed to walk on water, middle school teachbrs are 
expected to be all things to their students: teacher, parent, role model, disciplinarian, confidant, 
and provider of a whole array of counseling services-health, ^om personal hygie ^e through 
issues of substance abuse, pregnancy, who to deal with abusive and substance abusing 
parents. 

- Ifs a daunting list of needs; professionals specialized in several of these areas of need, and the 
graduate level preparation is often two years or more beyond a bachelor's degree! 



About Parents: 

* We haveni talked to parents directly, but all of the principals and the vast majority of thi^ teachers 
we talked to want more parent Involvement In their schoolf. 

- There were several suggestions from teachers regarding how to do this: nwre evening activities, 
like spaghetti supers: hiring staff in the office who can speak Spanish (so I'm not taken out of 
class): I'd like to give an adult education course for the parents, bo^n to help them learn more 
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about the needs of adolescent students and to get them In touch with what the scfy>ol is trying to 
do. 

- The family is the l^ey, m need mtensh/e family therapy %ith the teacher linked to the process. ' 

- One teacher told several heartbreaking stories: / wish we had more parents who cared; one 12- 
yemr girl was ceught smuggling cocmlne into her mom in the hospital. And eeriler this year, four 
students shot tn Boston were from our school. 

- When I have parental support here. It works. If I cell a parent about homeworK she will get on the 
kid. The real prot)lem is 'parents who do not support their kids gokyg to school.' 

• Both principals and teachers spolie of the importance of sharing Ideas on liow to get parents 
more involved. 



About Students: 

- As you know, your students completed our school climate questionnaire for students just two or 
three weeks ago. We have no formal daU arudysb as yet, but it will be underway as soon as we 
receive their computerized data on tape from a data processing firm. However, we do have a 'ot 
of information from the principals and teachers regarding your students: 

- Asked: "What do you like about teaching herer. alnrK)St all of our teacher respondents named 
'the Idds' right off the bat 

- One teacher complained of the perception that high schools in the system get more of the 
resources, but even she listed 'the students' as her reason for being in middle school and lil<ing 
It 

- Misc. comments from teachers on what you liked about teaching in your school: 
The students keep me creative. ' 

The kidSf they are reachable. " 

From a totally burned out teacher, nonetheless, ttm age of the kids, the enthusiasm of the 
students. ' 

'My students, my kids:' 

7Ve had opportunities for administrative positions, but that puts me too far from the kids I love 
the kids.' 

The aches and pains of puberty are everywhere. ' 

The kids; they're racialty diverse. You either love or hate this age group; no one wants it but I 
love It You have to be totally fair and GonsistenL' 

The students. They're the reason why I'm here. I toll my students, "You dont work for me, I work 
for your 

'We have great students here. ' 

- Conversations with principals echo the same sentiment 

On a first meeting with one principal in the midst of some chatter and introductions: 'Do you have 

any children? ' 

'Yes, I have 500 hundred!' 



This is the first of several reports you will receive on the results and interpretation of our collaborative 
research efforts. The formats will vary; some reports will be written, others oral; some formal, some 
informal. With the recent round of student data collections and more information from teachers 
forthcoming this month and next the pace of our activities in data analysis will pick up considerably. I close 
this letter with a chronology of major events so that you will know what has transpired and what will be 
taking place in the near future. Please report your reactions and suggestions lO the Boston University 
team through your school's representatives to the Research Advisory Council. Again, sincere thanks for 
your thoughtful participation and contributions to this research. 
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CHRONOLOGY OF MAJOR EVENTS 



Winter. 1988 : 

- Obtained permission from the CentrsI and District A offices of the Boston Pubiic Schoois to meet 
with principals and teachers about collaborative research on school effectiveness. 

Spiing. 1988: 

• Met with principals of the Curley, Edison, Lewis, and Taft Middle Schools to introduce our<;eives 
arxl the ideas fci collaborative research. 

• Met with several groups of teachers, cluster representatives, action team members, and individual 
teachers to explain the plans foi the study, to listen to your ideas and concerns, and to respond to 
valid criticisms about abuses and general lack of responsiveness on the part of investigators in 
previous studies in your schools. 

• Wrote a proposal to the US Department of Education for funding to support collaborative research 
with the four middle schools of Boston, District A, incorporating the best ideas on what new 
knowledge is needed and what resource? and practical in the conduct of the research must be 
included to make collaboration attractive to teachers and principals at the proposed sites. 

• Administered questionnaires to teachers in each of the four schools on your perceptions of the 
culture and climate of your schools, the responsibilities you face, your needs and priorities. Return 
rates ranged from 75% to 85% across the four schools. 

- Intenriewed representative subsamples of teachers, stratified by years of experience, grade(s) 
taught, gender, and teacher's raca/culture/ethnicity. 

Fall. 1988 

- Received announcement of US Department of Education award to conduct research for effective 
middle schools. Approxinr^ately 200 proposals were submitted. Only eight awards were made. 

- Resumed planning with principals. Identified who would serve as teacher representatives to the 
Research Advisory Council. Clarified responsibilities and benefits to ail parties in writing. 

• Constructed and pilot tested student questionnaires. Submitted to Advisory Council Members for 
critique at January 30, 1989 Castle Meeting at Boston University. 

- Analyzed teacher interview data for preliminary presentation at the January 30, 1989 meeting. 

• Submitted teacher questionnaire to data processing fimi for cor tputer coding of data. 
Winter. 1989 

• Planned, conducted, and processed information from January 30, 1989 Advisor Council Meeting 
attended by sample school administrators, teachers, oarent representatives. District leader, 
university based senior advisors, research associates, and staff. 

- Completed final edition of the student questionnaire. Obtained and validated translations into 
Spanish and Vietnamese. Printed a total of 2000 copies of the instrument. 

• Submitted the research plan and all tests and questionnaires to the Boston University Institutional 
Review Board to insure adequacy of provisions for the protection of the rights of human subjects in 
the research. 
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Scheduled end administered the Student School Climate Questionnaire in each of the four middle 
schools. Reviewed each questionnaire to assure that the student's name was obliterated. 
Submitted the questionnaires to a bonded data processing firm for computer coding of data. 

Created observation scales for surveying school facilities and their condition and use as reflected 
by signs, posters, furniture, books, equipment, other resources and visible displays. 



Early Spring, 1989 

- Wrote proposals to three potential sponsors for entering a new phase of this collaborative research 
during the 1989-90 academic year. I.e.. translating the research Into practice. 

- Revised and pilot tested the TOPS test of problem solving. Scheduled adminirtration in May, 
1989. 

* Revised the 1988 Teacher Questionnaire for administration In May. 1989. 

- Submitted new instruments and outline of procedures to Boston University Institutional Review 
Board for clearance on protection of the rights of hUiMsn subjects In research. 

To Be Done, Late Spring and Summer, 1989 

- Administer the TOPS test of problem solving to students 

* Administer the teacher questionnaire to all teachers in the four schools 

- Cor^duct Interviews of a representative subsamples of teachers 

- Analyze the student questionnaire data by school and present preliminary profiles of their 
students' data to the administrators ar>d teachers in each school. 

- Conduct the second meeting of the Research Advisory Council on Thursday. June 8. 1989. A 
major focus of discussion will be how to present the results In ways that are meaningful and useful 
to teachers. 

- Obtain data tapes from the Boston Public Schools Bureau of Research containing scores for 
District A middle school students on the following measures admiiiistered in May and June. 1989: 
Metropolitan AcNevement Test, Cun'Iculum Referenced Tests. HBJ tests, as appropriate. 

- Match test scores from various measures with student questionnaire records to produce a 
complete set of records for each Individual student, then destroy the original codes to prevent 
detection of any student's Identity. 

- Pursue comprehensive data analysis and report writing on the complete sets of data. 

- Make formal and Infonnsil reports to each school. 

- Prepare comprehensive and sumnnary analyses to the sponsoring agency in ways which assure 
the confidentlailty of each school and all individual participants. 

- Hope and pray that one of the new proposals will be awarded so that we may continue our 
collaborative efforts into the next academic year. We wil) report results of the 1988-89 work, no 
matterwhat A new grant would enable us to work wKh you: (1) In setting priorities according to the 
research resuKs.and: (2) on translating the research into practtee. 
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